2026-03-28 06:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 06:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 06:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-28 06:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-28 06:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 06:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 06:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 06:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 06:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 2479f85ad524d5df
2026-03-28 06:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 06:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-28T06_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 06:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 06:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 06:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 06:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 06:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 06:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 06:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 06:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-28 06:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 06:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 06:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 06:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 06:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 06:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 06:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 06:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 06:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 06:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 06:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-28 06:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 06:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 06:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 06:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 06:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 06:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 06:30:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:16 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 06:30:16 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for YA69116: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for PL61351: 2
2026-03-28 06:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-28 06:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with scrape type 2
2026-03-28 06:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with scrape type 2
2026-03-28 06:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a, identifier: PL61351
2026-03-28 06:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 06:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 06:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-28 06:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351 to the API
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:11Z',
 'fuel_type': 'diesel',
 'id': 'f9ddad94-b6c8-5f03-8a21-5df36bca4e3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL61351',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 209058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Saving data for PL61351: {'auction_closing_time': 1774716371.0, 'created_time': 1774557242.383892, 'last_price_update_time': 1774679417.817115}
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL61351') HTTP/1.1" 204 0
2026-03-28 06:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX19447%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for YX19447: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX87020%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for KX87020: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK97810%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for AK97810: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET15377%27 HTTP/1.1" 200 None
2026-03-28 06:30:17 [auto1.be] INFO: Scrape type for ET15377: 0
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-28 06:30:17 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB07200%27 HTTP/1.1" 200 None
2026-03-28 06:30:18 [auto1.be] INFO: Scrape type for UB07200: 0
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-28 06:30:18 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ36955%27 HTTP/1.1" 200 None
2026-03-28 06:30:18 [auto1.be] INFO: Scrape type for PZ36955: 0
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN43275%27 HTTP/1.1" 200 None
2026-03-28 06:30:18 [auto1.be] INFO: Scrape type for ZN43275: 0
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV76677%27 HTTP/1.1" 200 None
2026-03-28 06:30:18 [auto1.be] INFO: Scrape type for AV76677: 0
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-28 06:30:18 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN48445%27 HTTP/1.1" 200 None
2026-03-28 06:30:18 [auto1.be] INFO: Scrape type for JN48445: 0
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-28 06:30:18 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-28 06:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:19 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:19 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 06:30:19 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-28 06:30:19 [auto1.be] INFO: Scrape type for AB83336: 2
2026-03-28 06:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-28 06:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d949308-da85-51a3-8bc7-d5dee023bb14 with scrape type 2
2026-03-28 06:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d949308-da85-51a3-8bc7-d5dee023bb14 with scrape type 2
2026-03-28 06:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d949308-da85-51a3-8bc7-d5dee023bb14, identifier: AB83336
2026-03-28 06:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 06:30:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-28 06:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336 to the API
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:39Z',
 'fuel_type': 'diesel',
 'id': '9d949308-da85-51a3-8bc7-d5dee023bb14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB83336',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 168842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 319 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-28 06:30:19 [auto1.be] INFO: Saving data for AB83336: {'auction_closing_time': 1774884339.0, 'created_time': 1774265473.136375, 'last_price_update_time': 1774679419.965202}
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB83336') HTTP/1.1" 204 0
2026-03-28 06:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for YA69116: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX19447%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for YX19447: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX87020%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for KX87020: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK97810%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for AK97810: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET15377%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for ET15377: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB07200%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for UB07200: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ36955%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for PZ36955: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN43275%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for ZN43275: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV76677%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for AV76677: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN48445%27 HTTP/1.1" 200 None
2026-03-28 06:30:20 [auto1.be] INFO: Scrape type for JN48445: 0
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-28 06:30:20 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-28 06:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:21 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU94213%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for AU94213: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM90339%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for AM90339: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for FF69776: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: TA93870
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: ZR94706
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR94706%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for ZR94706: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: XL14792
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL14792%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for XL14792: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: JF06459
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for MK30308: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for KL42374: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: YX04122
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX04122%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for YX04122: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: PZ99747
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: XX88636
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX88636%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for XX88636: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: CH97070
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH97070%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for CH97070: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: TB53896
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: PL30549
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: JB83669
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB83669%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for JB83669: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: FD92001
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD92001%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for FD92001: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: LN19500
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN19500%27 HTTP/1.1" 200 None
2026-03-28 06:30:21 [auto1.be] INFO: Scrape type for LN19500: 0
2026-03-28 06:30:21 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for EL91929: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: KS47676
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: KU28222
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: AY67294
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY67294%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for AY67294: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: LN33262
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: HH92920
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH92920%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for HH92920: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: FD47610
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD47610%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for FD47610: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: YM92505
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM92505%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for YM92505: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: YA41293
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA41293%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for YA41293: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for ZS70359: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: WX65816
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX65816%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for WX65816: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for PR31064: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: YR74794
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR74794%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for YR74794: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: XC85996
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for LL08256: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for FL46625: 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Scrape type for BT72678: 2
2026-03-28 06:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-28 06:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3fd721-f191-50d4-af38-8d3542965825 with scrape type 2
2026-03-28 06:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3fd721-f191-50d4-af38-8d3542965825 with scrape type 2
2026-03-28 06:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f3fd721-f191-50d4-af38-8d3542965825, identifier: BT72678
2026-03-28 06:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-28 06:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-28 06:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678 to the API
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:05:00Z',
 'fuel_type': 'diesel',
 'id': '9f3fd721-f191-50d4-af38-8d3542965825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT72678',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 53294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'automatic',
 'trim': 'Feel M',
 'year': 2019}
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-28 06:30:22 [auto1.be] INFO: Saving data for BT72678: {'auction_closing_time': 1774713900.0, 'created_time': 1774557102.712934, 'last_price_update_time': 1774679422.753075}
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT72678') HTTP/1.1" 204 0
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-28 06:30:22 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-28 06:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:24 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for CE58685: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for ND78338: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for SB67636: 2
2026-03-28 06:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-28 06:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with scrape type 2
2026-03-28 06:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with scrape type 2
2026-03-28 06:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb, identifier: SB67636
2026-03-28 06:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-28 06:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-28 06:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636 to the API
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:58:53Z',
 'fuel_type': 'diesel',
 'id': 'cbebe295-ccd7-5e45-a4df-92b27a8f0ccb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB67636',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 204706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2020}
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Saving data for SB67636: {'auction_closing_time': 1774717133.0, 'created_time': 1774352243.056934, 'last_price_update_time': 1774679424.534249}
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB67636') HTTP/1.1" 204 0
2026-03-28 06:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA16602%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for NA16602: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for YC48670: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for XB95573: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for ZB59407: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: UA44926
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU56519%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for XU56519: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP21632%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for EP21632: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE64072%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for JE64072: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW18524%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for AW18524: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD31186%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for PD31186: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS20906%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for NS20906: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS66255%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for VS66255: 0
2026-03-28 06:30:24 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ96232%27 HTTP/1.1" 200 None
2026-03-28 06:30:24 [auto1.be] INFO: Scrape type for FZ96232: 2
2026-03-28 06:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b399eb5c-b2b4-5a1e-9a4a-0e4a070e07e0 with identifier: FZ96232
2026-03-28 06:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b399eb5c-b2b4-5a1e-9a4a-0e4a070e07e0 with scrape type 2
2026-03-28 06:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b399eb5c-b2b4-5a1e-9a4a-0e4a070e07e0 with scrape type 2
2026-03-28 06:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b399eb5c-b2b4-5a1e-9a4a-0e4a070e07e0, identifier: FZ96232
2026-03-28 06:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b399eb5c-b2b4-5a1e-9a4a-0e4a070e07e0 with identifier: FZ96232
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 06:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b399eb5c-b2b4-5a1e-9a4a-0e4a070e07e0 with identifier: FZ96232
2026-03-28 06:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b399eb5c-b2b4-5a1e-9a4a-0e4a070e07e0 with identifier: FZ96232 to the API
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:32Z',
 'fuel_type': 'diesel',
 'id': 'b399eb5c-b2b4-5a1e-9a4a-0e4a070e07e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ96232',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 151949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-24',
 'seller_name': None,
 'title': 'MINI Clubman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ96232%27 HTTP/1.1" 200 None
2026-03-28 06:30:25 [auto1.be] INFO: Saving data for FZ96232: {'auction_closing_time': 1774716332.0, 'created_time': 1774352217.847071, 'last_price_update_time': 1774679425.348048}
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FZ96232') HTTP/1.1" 204 0
2026-03-28 06:30:25 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-28 06:30:25 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-28 06:30:25 [auto1.be] INFO: Scrape type for RL24593: 2
2026-03-28 06:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-28 06:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9ef8c0e-2cfa-5d16-b352-8a129b53477b with scrape type 2
2026-03-28 06:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9ef8c0e-2cfa-5d16-b352-8a129b53477b with scrape type 2
2026-03-28 06:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d9ef8c0e-2cfa-5d16-b352-8a129b53477b, identifier: RL24593
2026-03-28 06:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 06:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 06:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-28 06:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593 to the API
2026-03-28 06:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:29:29Z',
 'fuel_type': 'petrol',
 'id': 'd9ef8c0e-2cfa-5d16-b352-8a129b53477b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL24593',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 95375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Citroen C2 1.1 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-03-28 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-28 06:30:26 [auto1.be] INFO: Saving data for RL24593: {'auction_closing_time': 1774715369.0, 'created_time': 1774557186.204094, 'last_price_update_time': 1774679426.150489}
2026-03-28 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL24593') HTTP/1.1" 204 0
2026-03-28 06:30:26 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-28 06:30:26 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-28 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ09914%27 HTTP/1.1" 200 None
2026-03-28 06:30:26 [auto1.be] INFO: Scrape type for ZJ09914: 0
2026-03-28 06:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:27 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-28 06:30:27 [auto1.be] INFO: Scrape type for HJ61714: 0
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-28 06:30:27 [auto1.be] INFO: Scrape type for UR44884: 2
2026-03-28 06:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-28 06:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006e77a7-b816-5d8f-903f-13762796f2d2 with scrape type 2
2026-03-28 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 006e77a7-b816-5d8f-903f-13762796f2d2 with scrape type 2
2026-03-28 06:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 006e77a7-b816-5d8f-903f-13762796f2d2, identifier: UR44884
2026-03-28 06:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-28 06:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-28 06:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884 to the API
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:05:58Z',
 'fuel_type': 'petrol',
 'id': '006e77a7-b816-5d8f-903f-13762796f2d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR44884',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 29909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-28 06:30:27 [auto1.be] INFO: Saving data for UR44884: {'auction_closing_time': 1774713958.0, 'created_time': 1774557206.163541, 'last_price_update_time': 1774679427.55238}
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR44884') HTTP/1.1" 204 0
2026-03-28 06:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX33442%27 HTTP/1.1" 200 None
2026-03-28 06:30:27 [auto1.be] INFO: Scrape type for DX33442: 0
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-28 06:30:27 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC60514%27 HTTP/1.1" 200 None
2026-03-28 06:30:27 [auto1.be] INFO: Scrape type for CC60514: 2
2026-03-28 06:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 828b3e32-8b40-52cc-8729-f0e924a655b2 with identifier: CC60514
2026-03-28 06:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 828b3e32-8b40-52cc-8729-f0e924a655b2 with scrape type 2
2026-03-28 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 828b3e32-8b40-52cc-8729-f0e924a655b2 with scrape type 2
2026-03-28 06:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 828b3e32-8b40-52cc-8729-f0e924a655b2, identifier: CC60514
2026-03-28 06:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 828b3e32-8b40-52cc-8729-f0e924a655b2 with identifier: CC60514
2026-03-28 06:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 828b3e32-8b40-52cc-8729-f0e924a655b2 with identifier: CC60514
2026-03-28 06:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 828b3e32-8b40-52cc-8729-f0e924a655b2 with identifier: CC60514 to the API
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:58:08Z',
 'fuel_type': 'petrol',
 'id': '828b3e32-8b40-52cc-8729-f0e924a655b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC60514',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 159679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-26',
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2015}
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC60514%27 HTTP/1.1" 200 None
2026-03-28 06:30:28 [auto1.be] INFO: Saving data for CC60514: {'auction_closing_time': 1774717088.0, 'created_time': 1774557213.099107, 'last_price_update_time': 1774679428.023045}
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC60514') HTTP/1.1" 204 0
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP07679%27 HTTP/1.1" 200 None
2026-03-28 06:30:28 [auto1.be] INFO: Scrape type for BP07679: 0
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ84732%27 HTTP/1.1" 200 None
2026-03-28 06:30:28 [auto1.be] INFO: Scrape type for BJ84732: 0
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-28 06:30:28 [auto1.be] INFO: Scrape type for TH79553: 2
2026-03-28 06:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-28 06:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1631e56e-713b-5129-a480-c2f713cdb8f5 with scrape type 2
2026-03-28 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1631e56e-713b-5129-a480-c2f713cdb8f5 with scrape type 2
2026-03-28 06:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1631e56e-713b-5129-a480-c2f713cdb8f5, identifier: TH79553
2026-03-28 06:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-28 06:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-28 06:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553 to the API
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:28:17Z',
 'fuel_type': 'petrol',
 'id': '1631e56e-713b-5129-a480-c2f713cdb8f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH79553',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 93406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-28',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2005}
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-28 06:30:28 [auto1.be] INFO: Saving data for TH79553: {'auction_closing_time': 1774715297.0, 'created_time': 1774557107.436338, 'last_price_update_time': 1774679428.607488}
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH79553') HTTP/1.1" 204 0
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF70171%27 HTTP/1.1" 200 None
2026-03-28 06:30:28 [auto1.be] INFO: Scrape type for HF70171: 0
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS11712%27 HTTP/1.1" 200 None
2026-03-28 06:30:28 [auto1.be] INFO: Scrape type for CS11712: 0
2026-03-28 06:30:28 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-28 06:30:28 [auto1.be] INFO: Scrape type for WA78577: 2
2026-03-28 06:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-28 06:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with scrape type 2
2026-03-28 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with scrape type 2
2026-03-28 06:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6, identifier: WA78577
2026-03-28 06:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-28 06:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-28 06:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577 to the API
2026-03-28 06:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:34:03Z',
 'fuel_type': 'diesel',
 'id': 'a603700c-8eed-5a9f-9b5e-2a3a80c36eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA78577',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 126790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-28 06:30:29 [auto1.be] INFO: Saving data for WA78577: {'auction_closing_time': 1774715643.0, 'created_time': 1774557074.542997, 'last_price_update_time': 1774679429.734888}
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA78577') HTTP/1.1" 204 0
2026-03-28 06:30:29 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY90859%27 HTTP/1.1" 200 None
2026-03-28 06:30:29 [auto1.be] INFO: Scrape type for NY90859: 0
2026-03-28 06:30:29 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-28 06:30:29 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-28 06:30:29 [auto1.be] INFO: Scrape type for YU54459: 2
2026-03-28 06:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada367ff-1056-592d-995a-8db30181397b with identifier: YU54459
2026-03-28 06:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada367ff-1056-592d-995a-8db30181397b with scrape type 2
2026-03-28 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ada367ff-1056-592d-995a-8db30181397b with scrape type 2
2026-03-28 06:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ada367ff-1056-592d-995a-8db30181397b, identifier: YU54459
2026-03-28 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ada367ff-1056-592d-995a-8db30181397b with identifier: YU54459
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ada367ff-1056-592d-995a-8db30181397b with identifier: YU54459
2026-03-28 06:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ada367ff-1056-592d-995a-8db30181397b with identifier: YU54459 to the API
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:31:18Z',
 'fuel_type': 'hybrid',
 'id': 'ada367ff-1056-592d-995a-8db30181397b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU54459',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 89759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-28 06:30:30 [auto1.be] INFO: Saving data for YU54459: {'auction_closing_time': 1774715478.0, 'created_time': 1773747599.32111, 'last_price_update_time': 1774679430.639044}
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU54459') HTTP/1.1" 204 0
2026-03-28 06:30:30 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-28 06:30:30 [auto1.be] INFO: Scrape type for ZJ26609: 2
2026-03-28 06:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-28 06:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af47f6a-5867-55f6-be17-46f1d0252695 with scrape type 2
2026-03-28 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4af47f6a-5867-55f6-be17-46f1d0252695 with scrape type 2
2026-03-28 06:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4af47f6a-5867-55f6-be17-46f1d0252695, identifier: ZJ26609
2026-03-28 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-28 06:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609 to the API
2026-03-28 06:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:28:17Z',
 'fuel_type': 'petrol',
 'id': '4af47f6a-5867-55f6-be17-46f1d0252695',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ26609',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 96165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-03',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-28 06:30:32 [auto1.be] INFO: Saving data for ZJ26609: {'auction_closing_time': 1774715297.0, 'created_time': 1774557187.648745, 'last_price_update_time': 1774679432.271338}
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ26609') HTTP/1.1" 204 0
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-28 06:30:32 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW97507%27 HTTP/1.1" 200 None
2026-03-28 06:30:32 [auto1.be] INFO: Scrape type for FW97507: 0
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-28 06:30:32 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-28 06:30:32 [auto1.be] INFO: Scrape type for BV48703: 0
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-28 06:30:32 [auto1.be] INFO: Scrape type for AP73624: 2
2026-03-28 06:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-28 06:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c55397c6-6523-538d-8401-e93bcfbe5d68 with scrape type 2
2026-03-28 06:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c55397c6-6523-538d-8401-e93bcfbe5d68 with scrape type 2
2026-03-28 06:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c55397c6-6523-538d-8401-e93bcfbe5d68, identifier: AP73624
2026-03-28 06:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-28 06:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-28 06:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624 to the API
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-28T16:51:54Z',
 'fuel_type': 'petrol',
 'id': 'c55397c6-6523-538d-8401-e93bcfbe5d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP73624',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 139592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2019}
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-28 06:30:32 [auto1.be] INFO: Saving data for AP73624: {'auction_closing_time': 1774716714.0, 'created_time': 1774557096.785178, 'last_price_update_time': 1774679432.803709}
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AP73624') HTTP/1.1" 204 0
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-28 06:30:32 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-28 06:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:33 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49424%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Scrape type for CD49424: 0
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB83529%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Scrape type for CB83529: 0
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY34389%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Scrape type for UY34389: 0
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE19111%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Scrape type for HE19111: 0
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW00406%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Scrape type for RW00406: 2
2026-03-28 06:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f68311d0-1ecc-575d-906f-63b0a5f1396d with identifier: RW00406
2026-03-28 06:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f68311d0-1ecc-575d-906f-63b0a5f1396d with scrape type 2
2026-03-28 06:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f68311d0-1ecc-575d-906f-63b0a5f1396d with scrape type 2
2026-03-28 06:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f68311d0-1ecc-575d-906f-63b0a5f1396d, identifier: RW00406
2026-03-28 06:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f68311d0-1ecc-575d-906f-63b0a5f1396d with identifier: RW00406
2026-03-28 06:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f68311d0-1ecc-575d-906f-63b0a5f1396d with identifier: RW00406
2026-03-28 06:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f68311d0-1ecc-575d-906f-63b0a5f1396d with identifier: RW00406 to the API
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-28T16:45:02Z',
 'fuel_type': 'hybrid',
 'id': 'f68311d0-1ecc-575d-906f-63b0a5f1396d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW00406',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 175003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350 T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2017}
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW00406%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Saving data for RW00406: {'auction_closing_time': 1774716302.0, 'created_time': 1773301740.777086, 'last_price_update_time': 1774679433.578823}
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW00406') HTTP/1.1" 204 0
2026-03-28 06:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36115%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Scrape type for UA36115: 0
2026-03-28 06:30:33 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-28 06:30:33 [auto1.be] INFO: Scrape type for XH41981: 2
2026-03-28 06:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-28 06:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with scrape type 2
2026-03-28 06:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with scrape type 2
2026-03-28 06:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa, identifier: XH41981
2026-03-28 06:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-28 06:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-28 06:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981 to the API
2026-03-28 06:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:28:49Z',
 'fuel_type': 'diesel',
 'id': '7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH41981',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 91890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI RWD L2',
 'transmission': 'manual',
 'trim': 'RWD L2',
 'year': 2019}
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Saving data for XH41981: {'auction_closing_time': 1774715329.0, 'created_time': 1774557203.357526, 'last_price_update_time': 1774679434.191459}
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH41981') HTTP/1.1" 204 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT11356%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for UT11356: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB25779%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for HB25779: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW76300%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for CW76300: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF87746%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for BF87746: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for RR89556: 2
2026-03-28 06:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-28 06:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with scrape type 2
2026-03-28 06:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with scrape type 2
2026-03-28 06:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29d8319a-52dc-5975-a22f-1e0071b3a6e5, identifier: RR89556
2026-03-28 06:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-28 06:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-28 06:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556 to the API
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:06:51Z',
 'fuel_type': 'petrol',
 'id': '29d8319a-52dc-5975-a22f-1e0071b3a6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR89556',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 19110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2019}
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Saving data for RR89556: {'auction_closing_time': 1774714011.0, 'created_time': 1774557195.308689, 'last_price_update_time': 1774679434.708606}
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR89556') HTTP/1.1" 204 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for JN34238: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP31982%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for NP31982: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for ZY23736: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ10477%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for DJ10477: 0
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-28 06:30:34 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-28 06:30:34 [auto1.be] INFO: Scrape type for WK92284: 2
2026-03-28 06:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-28 06:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3947d5f0-185f-5649-9c9d-932e1a474b66 with scrape type 2
2026-03-28 06:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3947d5f0-185f-5649-9c9d-932e1a474b66 with scrape type 2
2026-03-28 06:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3947d5f0-185f-5649-9c9d-932e1a474b66, identifier: WK92284
2026-03-28 06:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-28 06:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-28 06:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284 to the API
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:52:37Z',
 'fuel_type': 'diesel',
 'id': '3947d5f0-185f-5649-9c9d-932e1a474b66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK92284',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2018}
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-28 06:30:35 [auto1.be] INFO: Saving data for WK92284: {'auction_closing_time': 1774716757.0, 'created_time': 1774557104.921767, 'last_price_update_time': 1774679435.306437}
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK92284') HTTP/1.1" 204 0
2026-03-28 06:30:35 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-28 06:30:35 [auto1.be] INFO: Scrape type for YD21406: 2
2026-03-28 06:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-28 06:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1634e9f3-cdc8-5904-9a27-46341229dccf with scrape type 2
2026-03-28 06:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1634e9f3-cdc8-5904-9a27-46341229dccf with scrape type 2
2026-03-28 06:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1634e9f3-cdc8-5904-9a27-46341229dccf, identifier: YD21406
2026-03-28 06:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-28 06:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-28 06:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406 to the API
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:12:37Z',
 'fuel_type': 'petrol',
 'id': '1634e9f3-cdc8-5904-9a27-46341229dccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD21406',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 100905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.4 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2008}
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-28 06:30:35 [auto1.be] INFO: Saving data for YD21406: {'auction_closing_time': 1774714357.0, 'created_time': 1774557177.16566, 'last_price_update_time': 1774679435.809465}
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YD21406') HTTP/1.1" 204 0
2026-03-28 06:30:35 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-28 06:30:35 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC33949%27 HTTP/1.1" 200 None
2026-03-28 06:30:35 [auto1.be] INFO: Scrape type for CC33949: 0
2026-03-28 06:30:35 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ76068%27 HTTP/1.1" 200 None
2026-03-28 06:30:35 [auto1.be] INFO: Scrape type for ZZ76068: 0
2026-03-28 06:30:35 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY40613%27 HTTP/1.1" 200 None
2026-03-28 06:30:35 [auto1.be] INFO: Scrape type for TY40613: 2
2026-03-28 06:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606177ac-c31a-5b9a-96e6-340bbf153696 with identifier: TY40613
2026-03-28 06:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606177ac-c31a-5b9a-96e6-340bbf153696 with scrape type 2
2026-03-28 06:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606177ac-c31a-5b9a-96e6-340bbf153696 with scrape type 2
2026-03-28 06:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 606177ac-c31a-5b9a-96e6-340bbf153696, identifier: TY40613
2026-03-28 06:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 606177ac-c31a-5b9a-96e6-340bbf153696 with identifier: TY40613
2026-03-28 06:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 606177ac-c31a-5b9a-96e6-340bbf153696 with identifier: TY40613
2026-03-28 06:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 606177ac-c31a-5b9a-96e6-340bbf153696 with identifier: TY40613 to the API
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:30Z',
 'fuel_type': 'diesel',
 'id': '606177ac-c31a-5b9a-96e6-340bbf153696',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY40613',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 6131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-07',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 BLUE dCi Cabine Approfondie L1H1 3T Confort',
 'transmission': 'automatic',
 'trim': 'Cabine Approfondie L1H1 3T Confort',
 'year': 2024}
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY40613%27 HTTP/1.1" 200 None
2026-03-28 06:30:36 [auto1.be] INFO: Saving data for TY40613: {'auction_closing_time': 1774713810.0, 'created_time': 1773834216.008154, 'last_price_update_time': 1774679436.330843}
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY40613') HTTP/1.1" 204 0
2026-03-28 06:30:36 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-28 06:30:36 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-28 06:30:36 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC96000%27 HTTP/1.1" 200 None
2026-03-28 06:30:36 [auto1.be] INFO: Scrape type for FC96000: 0
2026-03-28 06:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:37 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:37 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-28 06:30:37 [auto1.be] INFO: Scrape type for DW61635: 2
2026-03-28 06:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-28 06:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e51fe1-0876-577a-8329-d692268c9773 with scrape type 2
2026-03-28 06:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e51fe1-0876-577a-8329-d692268c9773 with scrape type 2
2026-03-28 06:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 93e51fe1-0876-577a-8329-d692268c9773, identifier: DW61635
2026-03-28 06:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-28 06:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-28 06:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635 to the API
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:58:44Z',
 'fuel_type': 'petrol',
 'id': '93e51fe1-0876-577a-8329-d692268c9773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW61635',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 104639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-16',
 'seller_name': None,
 'title': 'Renault Megane 1.4 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2002}
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-28 06:30:37 [auto1.be] INFO: Saving data for DW61635: {'auction_closing_time': 1774717124.0, 'created_time': 1774557219.813369, 'last_price_update_time': 1774679437.76386}
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW61635') HTTP/1.1" 204 0
2026-03-28 06:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:37 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-28 06:30:37 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-28 06:30:37 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL73626%27 HTTP/1.1" 200 None
2026-03-28 06:30:37 [auto1.be] INFO: Scrape type for RL73626: 0
2026-03-28 06:30:37 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-28 06:30:37 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-28 06:30:37 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY67713%27 HTTP/1.1" 200 None
2026-03-28 06:30:37 [auto1.be] INFO: Scrape type for RY67713: 0
2026-03-28 06:30:37 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-28 06:30:37 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-28 06:30:37 [auto1.be] INFO: Scrape type for ML85388: 2
2026-03-28 06:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-28 06:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42769972-c432-5d32-aaf0-c251c5dd4e3c with scrape type 2
2026-03-28 06:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42769972-c432-5d32-aaf0-c251c5dd4e3c with scrape type 2
2026-03-28 06:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42769972-c432-5d32-aaf0-c251c5dd4e3c, identifier: ML85388
2026-03-28 06:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-28 06:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-28 06:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388 to the API
2026-03-28 06:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:57:49Z',
 'fuel_type': 'hybrid',
 'id': '42769972-c432-5d32-aaf0-c251c5dd4e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML85388',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 213734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-28 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-28 06:30:38 [auto1.be] INFO: Saving data for ML85388: {'auction_closing_time': 1774717069.0, 'created_time': 1774557179.473528, 'last_price_update_time': 1774679438.71641}
2026-03-28 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML85388') HTTP/1.1" 204 0
2026-03-28 06:30:38 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-28 06:30:38 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-28 06:30:38 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-28 06:30:38 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-28 06:30:38 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-28 06:30:38 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-28 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-28 06:30:38 [auto1.be] INFO: Scrape type for WU67286: 2
2026-03-28 06:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-28 06:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c5d6d2f-0524-5caf-8730-1b67876e390b with scrape type 2
2026-03-28 06:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c5d6d2f-0524-5caf-8730-1b67876e390b with scrape type 2
2026-03-28 06:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c5d6d2f-0524-5caf-8730-1b67876e390b, identifier: WU67286
2026-03-28 06:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-28 06:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-28 06:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286 to the API
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:33:01Z',
 'fuel_type': 'diesel',
 'id': '2c5d6d2f-0524-5caf-8730-1b67876e390b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU67286',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 256770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 CDTI Kasten L2H1 2,9t Doppelkabine',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t Doppelkabine',
 'year': 2013}
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Saving data for WU67286: {'auction_closing_time': 1774715581.0, 'created_time': 1774557071.226326, 'last_price_update_time': 1774679439.289258}
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU67286') HTTP/1.1" 204 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB51767%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for XB51767: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT01503%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for CT01503: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08126%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for GU08126: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR56379%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for XR56379: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for CW56663: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ05678%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for UZ05678: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX02409%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for WX02409: 0
2026-03-28 06:30:39 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV10256%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Scrape type for AV10256: 2
2026-03-28 06:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6361a5e-2d03-5408-a991-14fb2ed11108 with identifier: AV10256
2026-03-28 06:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6361a5e-2d03-5408-a991-14fb2ed11108 with scrape type 2
2026-03-28 06:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6361a5e-2d03-5408-a991-14fb2ed11108 with scrape type 2
2026-03-28 06:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e6361a5e-2d03-5408-a991-14fb2ed11108, identifier: AV10256
2026-03-28 06:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e6361a5e-2d03-5408-a991-14fb2ed11108 with identifier: AV10256
2026-03-28 06:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e6361a5e-2d03-5408-a991-14fb2ed11108 with identifier: AV10256
2026-03-28 06:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e6361a5e-2d03-5408-a991-14fb2ed11108 with identifier: AV10256 to the API
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'petrol',
 'id': 'e6361a5e-2d03-5408-a991-14fb2ed11108',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV10256',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 140553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-14',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV10256%27 HTTP/1.1" 200 None
2026-03-28 06:30:39 [auto1.be] INFO: Saving data for AV10256: {'auction_closing_time': 1774716349.0, 'created_time': 1774557193.245175, 'last_price_update_time': 1774679439.9568}
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV10256') HTTP/1.1" 204 0
2026-03-28 06:30:40 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-28 06:30:40 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-28 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA63870%27 HTTP/1.1" 200 None
2026-03-28 06:30:40 [auto1.be] INFO: Scrape type for TA63870: 0
2026-03-28 06:30:40 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-28 06:30:40 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-28 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV08230%27 HTTP/1.1" 200 None
2026-03-28 06:30:40 [auto1.be] INFO: Scrape type for MV08230: 0
2026-03-28 06:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:41 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-28 06:30:41 [auto1.be] INFO: Scrape type for VM79296: 2
2026-03-28 06:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-28 06:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16975dda-a13c-54ca-a9f5-8724e17b1f52 with scrape type 2
2026-03-28 06:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16975dda-a13c-54ca-a9f5-8724e17b1f52 with scrape type 2
2026-03-28 06:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16975dda-a13c-54ca-a9f5-8724e17b1f52, identifier: VM79296
2026-03-28 06:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-28 06:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-28 06:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296 to the API
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:20:39Z',
 'fuel_type': 'diesel',
 'id': '16975dda-a13c-54ca-a9f5-8724e17b1f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM79296',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Bipper',
 'odometer': 113242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Peugeot Bipper 1.3 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-28 06:30:41 [auto1.be] INFO: Saving data for VM79296: {'auction_closing_time': 1774714839.0, 'created_time': 1773434064.981091, 'last_price_update_time': 1774679441.677843}
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM79296') HTTP/1.1" 204 0
2026-03-28 06:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-28 06:30:41 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW40259%27 HTTP/1.1" 200 None
2026-03-28 06:30:41 [auto1.be] INFO: Scrape type for BW40259: 0
2026-03-28 06:30:41 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05656%27 HTTP/1.1" 200 None
2026-03-28 06:30:41 [auto1.be] INFO: Scrape type for GS05656: 2
2026-03-28 06:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da410cd-de73-59af-9c8f-38fd81dd8b09 with identifier: GS05656
2026-03-28 06:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da410cd-de73-59af-9c8f-38fd81dd8b09 with scrape type 2
2026-03-28 06:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da410cd-de73-59af-9c8f-38fd81dd8b09 with scrape type 2
2026-03-28 06:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4da410cd-de73-59af-9c8f-38fd81dd8b09, identifier: GS05656
2026-03-28 06:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4da410cd-de73-59af-9c8f-38fd81dd8b09 with identifier: GS05656
2026-03-28 06:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4da410cd-de73-59af-9c8f-38fd81dd8b09 with identifier: GS05656
2026-03-28 06:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4da410cd-de73-59af-9c8f-38fd81dd8b09 with identifier: GS05656 to the API
2026-03-28 06:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:27Z',
 'fuel_type': 'diesel',
 'id': '4da410cd-de73-59af-9c8f-38fd81dd8b09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS05656',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 219902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-23',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2013}
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05656%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Saving data for GS05656: {'auction_closing_time': 1774714647.0, 'created_time': 1773134346.379088, 'last_price_update_time': 1774679442.19234}
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS05656') HTTP/1.1" 204 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG52941%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for GG52941: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH43501%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for PH43501: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60712%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for YJ60712: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP39360%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for VP39360: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB60883%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for LB60883: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for JX04101: 2
2026-03-28 06:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-28 06:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d92782b-9b84-5c05-ae4a-9825cdb5422e with scrape type 2
2026-03-28 06:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d92782b-9b84-5c05-ae4a-9825cdb5422e with scrape type 2
2026-03-28 06:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d92782b-9b84-5c05-ae4a-9825cdb5422e, identifier: JX04101
2026-03-28 06:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-28 06:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-28 06:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101 to the API
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:26:40Z',
 'fuel_type': 'diesel',
 'id': '0d92782b-9b84-5c05-ae4a-9825cdb5422e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX04101',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 214547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Select 2WD',
 'transmission': 'manual',
 'trim': 'Select 2WD',
 'year': 2020}
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Saving data for JX04101: {'auction_closing_time': 1774715200.0, 'created_time': 1774557105.977778, 'last_price_update_time': 1774679442.774576}
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX04101') HTTP/1.1" 204 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP28232%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for CP28232: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK34546%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for DK34546: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ89311%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for UZ89311: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW65130%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for PW65130: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM60414%27 HTTP/1.1" 200 None
2026-03-28 06:30:42 [auto1.be] INFO: Scrape type for ZM60414: 0
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-28 06:30:42 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-28 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ47720%27 HTTP/1.1" 200 None
2026-03-28 06:30:43 [auto1.be] INFO: Scrape type for BJ47720: 0
2026-03-28 06:30:43 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-28 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-28 06:30:43 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-28 06:30:43 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-28 06:30:43 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-28 06:30:43 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-28 06:30:43 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-28 06:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:43 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC93311%27 HTTP/1.1" 200 None
2026-03-28 06:30:44 [auto1.be] INFO: Scrape type for YC93311: 0
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX24259%27 HTTP/1.1" 200 None
2026-03-28 06:30:44 [auto1.be] INFO: Scrape type for BX24259: 0
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN64395%27 HTTP/1.1" 200 None
2026-03-28 06:30:44 [auto1.be] INFO: Scrape type for MN64395: 0
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-28 06:30:44 [auto1.be] INFO: Scrape type for CM40127: 2
2026-03-28 06:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-28 06:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad2b87d4-38b4-5111-be04-c501effca679 with scrape type 2
2026-03-28 06:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad2b87d4-38b4-5111-be04-c501effca679 with scrape type 2
2026-03-28 06:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad2b87d4-38b4-5111-be04-c501effca679, identifier: CM40127
2026-03-28 06:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-28 06:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-28 06:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127 to the API
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:17:30Z',
 'fuel_type': 'hybrid',
 'id': 'ad2b87d4-38b4-5111-be04-c501effca679',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM40127',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 196238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-17',
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2011}
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-28 06:30:44 [auto1.be] INFO: Saving data for CM40127: {'auction_closing_time': 1774714650.0, 'created_time': 1774557197.630835, 'last_price_update_time': 1774679444.486957}
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM40127') HTTP/1.1" 204 0
2026-03-28 06:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:44 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-28 06:30:44 [auto1.be] INFO: Scrape type for YH98972: 2
2026-03-28 06:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-28 06:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6503a6bc-b391-5434-bbc5-2f2f987f650c with scrape type 2
2026-03-28 06:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6503a6bc-b391-5434-bbc5-2f2f987f650c with scrape type 2
2026-03-28 06:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6503a6bc-b391-5434-bbc5-2f2f987f650c, identifier: YH98972
2026-03-28 06:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-28 06:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-28 06:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972 to the API
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:19:26Z',
 'fuel_type': 'diesel',
 'id': '6503a6bc-b391-5434-bbc5-2f2f987f650c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH98972',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 198190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-15',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-28 06:30:45 [auto1.be] INFO: Saving data for YH98972: {'auction_closing_time': 1774714766.0, 'created_time': 1774557192.483845, 'last_price_update_time': 1774679445.034234}
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH98972') HTTP/1.1" 204 0
2026-03-28 06:30:45 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX66002%27 HTTP/1.1" 200 None
2026-03-28 06:30:45 [auto1.be] INFO: Scrape type for YX66002: 2
2026-03-28 06:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047507ba-8fae-5f60-91b4-76a19cbcaed3 with identifier: YX66002
2026-03-28 06:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047507ba-8fae-5f60-91b4-76a19cbcaed3 with scrape type 2
2026-03-28 06:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 047507ba-8fae-5f60-91b4-76a19cbcaed3 with scrape type 2
2026-03-28 06:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 047507ba-8fae-5f60-91b4-76a19cbcaed3, identifier: YX66002
2026-03-28 06:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 047507ba-8fae-5f60-91b4-76a19cbcaed3 with identifier: YX66002
2026-03-28 06:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 047507ba-8fae-5f60-91b4-76a19cbcaed3 with identifier: YX66002
2026-03-28 06:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 047507ba-8fae-5f60-91b4-76a19cbcaed3 with identifier: YX66002 to the API
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:37:20Z',
 'fuel_type': 'diesel',
 'id': '047507ba-8fae-5f60-91b4-76a19cbcaed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX66002',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 237665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-08',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2013}
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX66002%27 HTTP/1.1" 200 None
2026-03-28 06:30:45 [auto1.be] INFO: Saving data for YX66002: {'auction_closing_time': 1774715840.0, 'created_time': 1774557181.972948, 'last_price_update_time': 1774679445.433705}
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YX66002') HTTP/1.1" 204 0
2026-03-28 06:30:45 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-28 06:30:45 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-28 06:30:45 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-28 06:30:45 [auto1.be] INFO: Scrape type for MC94265: 2
2026-03-28 06:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-28 06:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with scrape type 2
2026-03-28 06:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with scrape type 2
2026-03-28 06:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc, identifier: MC94265
2026-03-28 06:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-28 06:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-28 06:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265 to the API
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:37Z',
 'fuel_type': 'diesel',
 'id': '3d2c4510-6a63-5a2d-ad98-5a094d473ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC94265',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 174400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-05',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2018}
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-28 06:30:45 [auto1.be] INFO: Saving data for MC94265: {'auction_closing_time': 1774714417.0, 'created_time': 1774557119.770076, 'last_price_update_time': 1774679445.832054}
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC94265') HTTP/1.1" 204 0
2026-03-28 06:30:45 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-28 06:30:45 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-28 06:30:45 [auto1.be] INFO: Scrape type for BA13225: 2
2026-03-28 06:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-28 06:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187da6b3-d1f2-5477-86c4-8669ced36174 with scrape type 2
2026-03-28 06:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187da6b3-d1f2-5477-86c4-8669ced36174 with scrape type 2
2026-03-28 06:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 187da6b3-d1f2-5477-86c4-8669ced36174, identifier: BA13225
2026-03-28 06:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-28 06:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-28 06:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225 to the API
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:40:28Z',
 'fuel_type': 'petrol',
 'id': '187da6b3-d1f2-5477-86c4-8669ced36174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA13225',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 56773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-07',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-28 06:30:46 [auto1.be] INFO: Saving data for BA13225: {'auction_closing_time': 1774716028.0, 'created_time': 1774557221.174339, 'last_price_update_time': 1774679446.238851}
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA13225') HTTP/1.1" 204 0
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT07874%27 HTTP/1.1" 200 None
2026-03-28 06:30:46 [auto1.be] INFO: Scrape type for FT07874: 0
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-28 06:30:46 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ75244%27 HTTP/1.1" 200 None
2026-03-28 06:30:46 [auto1.be] INFO: Scrape type for PZ75244: 0
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-28 06:30:46 [auto1.be] INFO: Scrape type for AJ68637: 2
2026-03-28 06:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-28 06:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with scrape type 2
2026-03-28 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with scrape type 2
2026-03-28 06:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01, identifier: AJ68637
2026-03-28 06:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-28 06:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-28 06:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637 to the API
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:57:44Z',
 'fuel_type': 'diesel',
 'id': 'ee21d84f-d6ac-5fbd-b303-1b42f25e0b01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ68637',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 282721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2019}
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-28 06:30:46 [auto1.be] INFO: Saving data for AJ68637: {'auction_closing_time': 1774717064.0, 'created_time': 1774557210.944023, 'last_price_update_time': 1774679446.716259}
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AJ68637') HTTP/1.1" 204 0
2026-03-28 06:30:46 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL09185%27 HTTP/1.1" 200 None
2026-03-28 06:30:46 [auto1.be] INFO: Scrape type for UL09185: 2
2026-03-28 06:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 692c8e70-d66d-5dc5-8083-b92ca7db4658 with identifier: UL09185
2026-03-28 06:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 692c8e70-d66d-5dc5-8083-b92ca7db4658 with scrape type 2
2026-03-28 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 692c8e70-d66d-5dc5-8083-b92ca7db4658 with scrape type 2
2026-03-28 06:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 692c8e70-d66d-5dc5-8083-b92ca7db4658, identifier: UL09185
2026-03-28 06:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 692c8e70-d66d-5dc5-8083-b92ca7db4658 with identifier: UL09185
2026-03-28 06:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 692c8e70-d66d-5dc5-8083-b92ca7db4658 with identifier: UL09185
2026-03-28 06:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 692c8e70-d66d-5dc5-8083-b92ca7db4658 with identifier: UL09185 to the API
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:27:33Z',
 'fuel_type': 'petrol',
 'id': '692c8e70-d66d-5dc5-8083-b92ca7db4658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL09185',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 181215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-15',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL09185%27 HTTP/1.1" 200 None
2026-03-28 06:30:47 [auto1.be] INFO: Saving data for UL09185: {'auction_closing_time': 1774715253.0, 'created_time': 1774265515.53438, 'last_price_update_time': 1774679447.254967}
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL09185') HTTP/1.1" 204 0
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE16850%27 HTTP/1.1" 200 None
2026-03-28 06:30:47 [auto1.be] INFO: Scrape type for CE16850: 0
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV15800%27 HTTP/1.1" 200 None
2026-03-28 06:30:47 [auto1.be] INFO: Scrape type for GV15800: 0
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-28 06:30:47 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-28 06:30:47 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-28 06:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:48 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC09650%27 HTTP/1.1" 200 None
2026-03-28 06:30:48 [auto1.be] INFO: Scrape type for BC09650: 0
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR44884%27 HTTP/1.1" 200 None
2026-03-28 06:30:48 [auto1.be] INFO: Scrape type for PR44884: 2
2026-03-28 06:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c65eb4-893a-59c4-b01d-93abaf73454b with identifier: PR44884
2026-03-28 06:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c65eb4-893a-59c4-b01d-93abaf73454b with scrape type 2
2026-03-28 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8c65eb4-893a-59c4-b01d-93abaf73454b with scrape type 2
2026-03-28 06:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c8c65eb4-893a-59c4-b01d-93abaf73454b, identifier: PR44884
2026-03-28 06:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c8c65eb4-893a-59c4-b01d-93abaf73454b with identifier: PR44884
2026-03-28 06:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c8c65eb4-893a-59c4-b01d-93abaf73454b with identifier: PR44884
2026-03-28 06:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c8c65eb4-893a-59c4-b01d-93abaf73454b with identifier: PR44884 to the API
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:13:42Z',
 'fuel_type': 'diesel',
 'id': 'c8c65eb4-893a-59c4-b01d-93abaf73454b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR44884',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 255776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-15',
 'seller_name': None,
 'title': 'BMW 1er 114d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR44884%27 HTTP/1.1" 200 None
2026-03-28 06:30:48 [auto1.be] INFO: Saving data for PR44884: {'auction_closing_time': 1774714422.0, 'created_time': 1773779928.010699, 'last_price_update_time': 1774679448.58589}
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR44884') HTTP/1.1" 204 0
2026-03-28 06:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG36975%27 HTTP/1.1" 200 None
2026-03-28 06:30:48 [auto1.be] INFO: Scrape type for MG36975: 0
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-28 06:30:48 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-28 06:30:48 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-28 06:30:48 [auto1.be] INFO: Scrape type for PE83293: 2
2026-03-28 06:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-28 06:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a7db30-7d11-5a08-b83c-36646e27f7c9 with scrape type 2
2026-03-28 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4a7db30-7d11-5a08-b83c-36646e27f7c9 with scrape type 2
2026-03-28 06:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4a7db30-7d11-5a08-b83c-36646e27f7c9, identifier: PE83293
2026-03-28 06:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-28 06:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-28 06:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293 to the API
2026-03-28 06:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:49:33Z',
 'fuel_type': 'petrol',
 'id': 'b4a7db30-7d11-5a08-b83c-36646e27f7c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE83293',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 57690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-28 06:30:49 [auto1.be] INFO: Saving data for PE83293: {'auction_closing_time': 1774716573.0, 'created_time': 1774557191.550311, 'last_price_update_time': 1774679449.1389}
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE83293') HTTP/1.1" 204 0
2026-03-28 06:30:49 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB57627%27 HTTP/1.1" 200 None
2026-03-28 06:30:49 [auto1.be] INFO: Scrape type for CB57627: 0
2026-03-28 06:30:49 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-28 06:30:49 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW84802%27 HTTP/1.1" 200 None
2026-03-28 06:30:49 [auto1.be] INFO: Scrape type for ZW84802: 2
2026-03-28 06:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cf14a7f-9936-52b1-8fcb-cc97b208d176 with identifier: ZW84802
2026-03-28 06:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cf14a7f-9936-52b1-8fcb-cc97b208d176 with scrape type 2
2026-03-28 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cf14a7f-9936-52b1-8fcb-cc97b208d176 with scrape type 2
2026-03-28 06:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cf14a7f-9936-52b1-8fcb-cc97b208d176, identifier: ZW84802
2026-03-28 06:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cf14a7f-9936-52b1-8fcb-cc97b208d176 with identifier: ZW84802
2026-03-28 06:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cf14a7f-9936-52b1-8fcb-cc97b208d176 with identifier: ZW84802
2026-03-28 06:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cf14a7f-9936-52b1-8fcb-cc97b208d176 with identifier: ZW84802 to the API
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:05:29Z',
 'fuel_type': 'petrol',
 'id': '5cf14a7f-9936-52b1-8fcb-cc97b208d176',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW84802',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 161117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-11-19',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Cool Wave',
 'transmission': 'manual',
 'trim': 'Cool Wave',
 'year': 1998}
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW84802%27 HTTP/1.1" 200 None
2026-03-28 06:30:49 [auto1.be] INFO: Saving data for ZW84802: {'auction_closing_time': 1774713929.0, 'created_time': 1774265518.048625, 'last_price_update_time': 1774679449.595328}
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZW84802') HTTP/1.1" 204 0
2026-03-28 06:30:49 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ77507%27 HTTP/1.1" 200 None
2026-03-28 06:30:49 [auto1.be] INFO: Scrape type for HZ77507: 0
2026-03-28 06:30:49 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM05069%27 HTTP/1.1" 200 None
2026-03-28 06:30:49 [auto1.be] INFO: Scrape type for TM05069: 2
2026-03-28 06:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d06a10c-acbe-5784-be5a-43761cd2b6ea with identifier: TM05069
2026-03-28 06:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d06a10c-acbe-5784-be5a-43761cd2b6ea with scrape type 2
2026-03-28 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d06a10c-acbe-5784-be5a-43761cd2b6ea with scrape type 2
2026-03-28 06:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d06a10c-acbe-5784-be5a-43761cd2b6ea, identifier: TM05069
2026-03-28 06:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d06a10c-acbe-5784-be5a-43761cd2b6ea with identifier: TM05069
2026-03-28 06:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d06a10c-acbe-5784-be5a-43761cd2b6ea with identifier: TM05069
2026-03-28 06:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d06a10c-acbe-5784-be5a-43761cd2b6ea with identifier: TM05069 to the API
2026-03-28 06:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:25:25Z',
 'fuel_type': 'hybrid',
 'id': '2d06a10c-acbe-5784-be5a-43761cd2b6ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM05069',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 106310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-17',
 'seller_name': None,
 'title': 'Kia Optima 2.0 Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2014}
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM05069%27 HTTP/1.1" 200 None
2026-03-28 06:30:50 [auto1.be] INFO: Saving data for TM05069: {'auction_closing_time': 1774715125.0, 'created_time': 1773136537.871531, 'last_price_update_time': 1774679450.132174}
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM05069') HTTP/1.1" 204 0
2026-03-28 06:30:50 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ24025%27 HTTP/1.1" 200 None
2026-03-28 06:30:50 [auto1.be] INFO: Scrape type for EJ24025: 2
2026-03-28 06:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b675aa3-3e60-5e49-af4d-20126e69e9f3 with identifier: EJ24025
2026-03-28 06:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b675aa3-3e60-5e49-af4d-20126e69e9f3 with scrape type 2
2026-03-28 06:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b675aa3-3e60-5e49-af4d-20126e69e9f3 with scrape type 2
2026-03-28 06:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b675aa3-3e60-5e49-af4d-20126e69e9f3, identifier: EJ24025
2026-03-28 06:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b675aa3-3e60-5e49-af4d-20126e69e9f3 with identifier: EJ24025
2026-03-28 06:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b675aa3-3e60-5e49-af4d-20126e69e9f3 with identifier: EJ24025
2026-03-28 06:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b675aa3-3e60-5e49-af4d-20126e69e9f3 with identifier: EJ24025 to the API
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:58:23Z',
 'fuel_type': 'petrol',
 'id': '4b675aa3-3e60-5e49-af4d-20126e69e9f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ24025',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 146716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ24025%27 HTTP/1.1" 200 None
2026-03-28 06:30:50 [auto1.be] INFO: Saving data for EJ24025: {'auction_closing_time': 1774717103.0, 'created_time': 1773301653.183516, 'last_price_update_time': 1774679450.548621}
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ24025') HTTP/1.1" 204 0
2026-03-28 06:30:50 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-28 06:30:50 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY81514%27 HTTP/1.1" 200 None
2026-03-28 06:30:50 [auto1.be] INFO: Scrape type for BY81514: 0
2026-03-28 06:30:50 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG30723%27 HTTP/1.1" 200 None
2026-03-28 06:30:50 [auto1.be] INFO: Scrape type for PG30723: 0
2026-03-28 06:30:50 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL22892%27 HTTP/1.1" 200 None
2026-03-28 06:30:50 [auto1.be] INFO: Scrape type for PL22892: 0
2026-03-28 06:30:50 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-28 06:30:50 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS95161%27 HTTP/1.1" 200 None
2026-03-28 06:30:50 [auto1.be] INFO: Scrape type for MS95161: 0
2026-03-28 06:30:50 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE96369%27 HTTP/1.1" 200 None
2026-03-28 06:30:50 [auto1.be] INFO: Scrape type for SE96369: 2
2026-03-28 06:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67453c83-1f40-5953-bb45-37aba9d03ecf with identifier: SE96369
2026-03-28 06:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67453c83-1f40-5953-bb45-37aba9d03ecf with scrape type 2
2026-03-28 06:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67453c83-1f40-5953-bb45-37aba9d03ecf with scrape type 2
2026-03-28 06:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 67453c83-1f40-5953-bb45-37aba9d03ecf, identifier: SE96369
2026-03-28 06:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 67453c83-1f40-5953-bb45-37aba9d03ecf with identifier: SE96369
2026-03-28 06:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 67453c83-1f40-5953-bb45-37aba9d03ecf with identifier: SE96369
2026-03-28 06:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 67453c83-1f40-5953-bb45-37aba9d03ecf with identifier: SE96369 to the API
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:37Z',
 'fuel_type': 'diesel',
 'id': '67453c83-1f40-5953-bb45-37aba9d03ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE96369',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 262284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-04',
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 2.0 Turbodiesel TD XL7 Comfort',
 'transmission': 'manual',
 'trim': 'TD XL7 Comfort',
 'year': 2005}
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE96369%27 HTTP/1.1" 200 None
2026-03-28 06:30:51 [auto1.be] INFO: Saving data for SE96369: {'auction_closing_time': 1774716217.0, 'created_time': 1773779711.188616, 'last_price_update_time': 1774679451.039175}
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE96369') HTTP/1.1" 204 0
2026-03-28 06:30:51 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-28 06:30:51 [auto1.be] INFO: Scrape type for UV50609: 2
2026-03-28 06:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-28 06:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd041ed9-0e63-5459-87c1-cc2e6f82a8da with scrape type 2
2026-03-28 06:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd041ed9-0e63-5459-87c1-cc2e6f82a8da with scrape type 2
2026-03-28 06:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd041ed9-0e63-5459-87c1-cc2e6f82a8da, identifier: UV50609
2026-03-28 06:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-28 06:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-28 06:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609 to the API
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:24Z',
 'fuel_type': 'diesel',
 'id': 'cd041ed9-0e63-5459-87c1-cc2e6f82a8da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV50609',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 187875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-28 06:30:51 [auto1.be] INFO: Saving data for UV50609: {'auction_closing_time': 1774714584.0, 'created_time': 1774557095.193738, 'last_price_update_time': 1774679451.475385}
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV50609') HTTP/1.1" 204 0
2026-03-28 06:30:51 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-28 06:30:51 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-28 06:30:51 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ56411%27 HTTP/1.1" 200 None
2026-03-28 06:30:51 [auto1.be] INFO: Scrape type for JZ56411: 0
2026-03-28 06:30:51 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY73004%27 HTTP/1.1" 200 None
2026-03-28 06:30:51 [auto1.be] INFO: Scrape type for NY73004: 0
2026-03-28 06:30:51 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-28 06:30:51 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-28 06:30:51 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-28 06:30:51 [auto1.be] INFO: Scrape type for JV95971: 2
2026-03-28 06:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-28 06:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with scrape type 2
2026-03-28 06:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with scrape type 2
2026-03-28 06:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54, identifier: JV95971
2026-03-28 06:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-28 06:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-28 06:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971 to the API
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:01:08Z',
 'fuel_type': 'diesel',
 'id': '9007042e-c0f4-502a-ac2e-7bb33ba6ea54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV95971',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 180959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper D Highgate',
 'transmission': 'manual',
 'trim': 'Highgate',
 'year': 2013}
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-28 06:30:52 [auto1.be] INFO: Saving data for JV95971: {'auction_closing_time': 1774713668.0, 'created_time': 1773779817.748891, 'last_price_update_time': 1774679452.042299}
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV95971') HTTP/1.1" 204 0
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-28 06:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:52 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-28 06:30:52 [auto1.be] INFO: Scrape type for AX58227: 2
2026-03-28 06:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-28 06:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78a19676-1b6e-5222-a431-c70f0c69f0da with scrape type 2
2026-03-28 06:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78a19676-1b6e-5222-a431-c70f0c69f0da with scrape type 2
2026-03-28 06:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78a19676-1b6e-5222-a431-c70f0c69f0da, identifier: AX58227
2026-03-28 06:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 06:30:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-28 06:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227 to the API
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:29:12Z',
 'fuel_type': 'petrol',
 'id': '78a19676-1b6e-5222-a431-c70f0c69f0da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX58227',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 177531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-28 06:30:52 [auto1.be] INFO: Saving data for AX58227: {'auction_closing_time': 1774715352.0, 'created_time': 1774557178.874044, 'last_price_update_time': 1774679452.724418}
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX58227') HTTP/1.1" 204 0
2026-03-28 06:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD83963%27 HTTP/1.1" 200 None
2026-03-28 06:30:52 [auto1.be] INFO: Scrape type for MD83963: 0
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-28 06:30:52 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA85166%27 HTTP/1.1" 200 None
2026-03-28 06:30:52 [auto1.be] INFO: Scrape type for TA85166: 2
2026-03-28 06:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20a4ed49-b9d7-581c-bf7b-9a05a778d46f with identifier: TA85166
2026-03-28 06:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20a4ed49-b9d7-581c-bf7b-9a05a778d46f with scrape type 2
2026-03-28 06:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20a4ed49-b9d7-581c-bf7b-9a05a778d46f with scrape type 2
2026-03-28 06:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20a4ed49-b9d7-581c-bf7b-9a05a778d46f, identifier: TA85166
2026-03-28 06:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20a4ed49-b9d7-581c-bf7b-9a05a778d46f with identifier: TA85166
2026-03-28 06:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20a4ed49-b9d7-581c-bf7b-9a05a778d46f with identifier: TA85166
2026-03-28 06:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20a4ed49-b9d7-581c-bf7b-9a05a778d46f with identifier: TA85166 to the API
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:39:11Z',
 'fuel_type': 'diesel',
 'id': '20a4ed49-b9d7-581c-bf7b-9a05a778d46f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA85166',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 228298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-18',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2012}
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA85166%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Saving data for TA85166: {'auction_closing_time': 1774715951.0, 'created_time': 1773952844.793456, 'last_price_update_time': 1774679453.24695}
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TA85166') HTTP/1.1" 204 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for ET09366: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ80656%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for LJ80656: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD99955%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for TD99955: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW20724%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for MW20724: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for ZH14526: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD94146%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for SD94146: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA04949%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for KA04949: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK67799%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for NK67799: 2
2026-03-28 06:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837f23ba-d982-5252-9e92-635b4d1ef2ce with identifier: NK67799
2026-03-28 06:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837f23ba-d982-5252-9e92-635b4d1ef2ce with scrape type 2
2026-03-28 06:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 837f23ba-d982-5252-9e92-635b4d1ef2ce with scrape type 2
2026-03-28 06:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 837f23ba-d982-5252-9e92-635b4d1ef2ce, identifier: NK67799
2026-03-28 06:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 837f23ba-d982-5252-9e92-635b4d1ef2ce with identifier: NK67799
2026-03-28 06:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 837f23ba-d982-5252-9e92-635b4d1ef2ce with identifier: NK67799
2026-03-28 06:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 837f23ba-d982-5252-9e92-635b4d1ef2ce with identifier: NK67799 to the API
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:11:40Z',
 'fuel_type': 'diesel',
 'id': '837f23ba-d982-5252-9e92-635b4d1ef2ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK67799',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 182840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L2 Trend',
 'transmission': 'manual',
 'trim': '350 L2 Trend',
 'year': 2016}
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK67799%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Saving data for NK67799: {'auction_closing_time': 1774714300.0, 'created_time': 1773225574.947347, 'last_price_update_time': 1774679453.872275}
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NK67799') HTTP/1.1" 204 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX33825%27 HTTP/1.1" 200 None
2026-03-28 06:30:53 [auto1.be] INFO: Scrape type for XX33825: 0
2026-03-28 06:30:53 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-28 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH72500%27 HTTP/1.1" 200 None
2026-03-28 06:30:54 [auto1.be] INFO: Scrape type for VH72500: 2
2026-03-28 06:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e53b5d0-0006-592f-9f72-a6867585ce89 with identifier: VH72500
2026-03-28 06:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e53b5d0-0006-592f-9f72-a6867585ce89 with scrape type 2
2026-03-28 06:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e53b5d0-0006-592f-9f72-a6867585ce89 with scrape type 2
2026-03-28 06:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1e53b5d0-0006-592f-9f72-a6867585ce89, identifier: VH72500
2026-03-28 06:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1e53b5d0-0006-592f-9f72-a6867585ce89 with identifier: VH72500
2026-03-28 06:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1e53b5d0-0006-592f-9f72-a6867585ce89 with identifier: VH72500
2026-03-28 06:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1e53b5d0-0006-592f-9f72-a6867585ce89 with identifier: VH72500 to the API
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:53:15Z',
 'fuel_type': 'diesel',
 'id': '1e53b5d0-0006-592f-9f72-a6867585ce89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH72500',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 231929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
 'transmission': 'manual',
 'trim': 'ECOnetic',
 'year': 2009}
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH72500%27 HTTP/1.1" 200 None
2026-03-28 06:30:54 [auto1.be] INFO: Saving data for VH72500: {'auction_closing_time': 1774716795.0, 'created_time': 1773135138.996408, 'last_price_update_time': 1774679454.381444}
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VH72500') HTTP/1.1" 204 0
2026-03-28 06:30:54 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT71351%27 HTTP/1.1" 200 None
2026-03-28 06:30:54 [auto1.be] INFO: Scrape type for PT71351: 0
2026-03-28 06:30:54 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY41289%27 HTTP/1.1" 200 None
2026-03-28 06:30:54 [auto1.be] INFO: Scrape type for ZY41289: 0
2026-03-28 06:30:54 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK54549%27 HTTP/1.1" 200 None
2026-03-28 06:30:54 [auto1.be] INFO: Scrape type for UK54549: 2
2026-03-28 06:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb16dfc-d385-5dae-8f51-6224308ac733 with identifier: UK54549
2026-03-28 06:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb16dfc-d385-5dae-8f51-6224308ac733 with scrape type 2
2026-03-28 06:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecb16dfc-d385-5dae-8f51-6224308ac733 with scrape type 2
2026-03-28 06:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ecb16dfc-d385-5dae-8f51-6224308ac733, identifier: UK54549
2026-03-28 06:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ecb16dfc-d385-5dae-8f51-6224308ac733 with identifier: UK54549
2026-03-28 06:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ecb16dfc-d385-5dae-8f51-6224308ac733 with identifier: UK54549
2026-03-28 06:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ecb16dfc-d385-5dae-8f51-6224308ac733 with identifier: UK54549 to the API
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:47:47Z',
 'fuel_type': 'diesel',
 'id': 'ecb16dfc-d385-5dae-8f51-6224308ac733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK54549',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 158229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK54549%27 HTTP/1.1" 200 None
2026-03-28 06:30:54 [auto1.be] INFO: Saving data for UK54549: {'auction_closing_time': 1774716467.0, 'created_time': 1774471336.076279, 'last_price_update_time': 1774679454.845436}
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UK54549') HTTP/1.1" 204 0
2026-03-28 06:30:54 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-28 06:30:54 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-28 06:30:54 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-28 06:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:30:55 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1663 | hits on page: 40
2026-03-28 06:30:55 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-28 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY69206%27 HTTP/1.1" 200 None
2026-03-28 06:30:55 [auto1.be] INFO: Scrape type for HY69206: 0
2026-03-28 06:30:55 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-28 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR25355%27 HTTP/1.1" 200 None
2026-03-28 06:30:55 [auto1.be] INFO: Scrape type for KR25355: 0
2026-03-28 06:30:55 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-28 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED19448%27 HTTP/1.1" 200 None
2026-03-28 06:30:55 [auto1.be] INFO: Scrape type for ED19448: 0
2026-03-28 06:30:55 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-28 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-28 06:30:55 [auto1.be] INFO: Scrape type for CS08088: 2
2026-03-28 06:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-28 06:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfe1580-0708-5d4e-a83f-c5de661cf19d with scrape type 2
2026-03-28 06:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adfe1580-0708-5d4e-a83f-c5de661cf19d with scrape type 2
2026-03-28 06:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: adfe1580-0708-5d4e-a83f-c5de661cf19d, identifier: CS08088
2026-03-28 06:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-28 06:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-28 06:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088 to the API
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:28Z',
 'fuel_type': 'petrol',
 'id': 'adfe1580-0708-5d4e-a83f-c5de661cf19d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS08088',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 73097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-28 06:30:56 [auto1.be] INFO: Saving data for CS08088: {'auction_closing_time': 1774715968.0, 'created_time': 1774557073.305658, 'last_price_update_time': 1774679456.275392}
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS08088') HTTP/1.1" 204 0
2026-03-28 06:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:30:56 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-28 06:30:56 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-28 06:30:56 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-28 06:30:56 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32534%27 HTTP/1.1" 200 None
2026-03-28 06:30:56 [auto1.be] INFO: Scrape type for HU32534: 2
2026-03-28 06:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c2147f1-462c-5202-9b79-be58241b9620 with identifier: HU32534
2026-03-28 06:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c2147f1-462c-5202-9b79-be58241b9620 with scrape type 2
2026-03-28 06:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c2147f1-462c-5202-9b79-be58241b9620 with scrape type 2
2026-03-28 06:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6c2147f1-462c-5202-9b79-be58241b9620, identifier: HU32534
2026-03-28 06:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6c2147f1-462c-5202-9b79-be58241b9620 with identifier: HU32534
2026-03-28 06:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6c2147f1-462c-5202-9b79-be58241b9620 with identifier: HU32534
2026-03-28 06:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6c2147f1-462c-5202-9b79-be58241b9620 with identifier: HU32534 to the API
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:43:02Z',
 'fuel_type': 'petrol',
 'id': '6c2147f1-462c-5202-9b79-be58241b9620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU32534',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 216448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32534%27 HTTP/1.1" 200 None
2026-03-28 06:30:56 [auto1.be] INFO: Saving data for HU32534: {'auction_closing_time': 1774716182.0, 'created_time': 1774471330.696441, 'last_price_update_time': 1774679456.807038}
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU32534') HTTP/1.1" 204 0
2026-03-28 06:30:56 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-28 06:30:56 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-28 06:30:56 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-28 06:30:56 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-28 06:30:56 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-28 06:30:56 [auto1.be] INFO: Scrape type for TT75307: 2
2026-03-28 06:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-28 06:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be96da6-1122-530d-ac76-d4cae71b5afe with scrape type 2
2026-03-28 06:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be96da6-1122-530d-ac76-d4cae71b5afe with scrape type 2
2026-03-28 06:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7be96da6-1122-530d-ac76-d4cae71b5afe, identifier: TT75307
2026-03-28 06:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-28 06:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-28 06:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307 to the API
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:26Z',
 'fuel_type': 'diesel',
 'id': '7be96da6-1122-530d-ac76-d4cae71b5afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT75307',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 65422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-05',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2021}
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Saving data for TT75307: {'auction_closing_time': 1774715906.0, 'created_time': 1774557235.793881, 'last_price_update_time': 1774679457.251034}
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TT75307') HTTP/1.1" 204 0
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB32239%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Scrape type for GB32239: 0
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF08223%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Scrape type for GF08223: 0
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV92742%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Scrape type for PV92742: 0
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Scrape type for TH53375: 2
2026-03-28 06:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-28 06:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with scrape type 2
2026-03-28 06:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with scrape type 2
2026-03-28 06:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 308b899d-5b1e-5d13-82a6-60fff2b4edd5, identifier: TH53375
2026-03-28 06:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-28 06:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-28 06:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375 to the API
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:11Z',
 'fuel_type': 'diesel',
 'id': '308b899d-5b1e-5d13-82a6-60fff2b4edd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH53375',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 177464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI lang Select',
 'transmission': 'automatic',
 'trim': 'lang Select',
 'year': 2017}
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Saving data for TH53375: {'auction_closing_time': 1774716731.0, 'created_time': 1774557152.940883, 'last_price_update_time': 1774679457.770558}
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH53375') HTTP/1.1" 204 0
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY74767%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Scrape type for WY74767: 0
2026-03-28 06:30:57 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-28 06:30:57 [auto1.be] INFO: Scrape type for WA10715: 2
2026-03-28 06:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-28 06:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b06023d-030b-506e-9366-3f2bfff4ecb6 with scrape type 2
2026-03-28 06:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b06023d-030b-506e-9366-3f2bfff4ecb6 with scrape type 2
2026-03-28 06:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b06023d-030b-506e-9366-3f2bfff4ecb6, identifier: WA10715
2026-03-28 06:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-28 06:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-28 06:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715 to the API
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:27Z',
 'fuel_type': 'petrol',
 'id': '6b06023d-030b-506e-9366-3f2bfff4ecb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA10715',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 80846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-28 06:30:58 [auto1.be] INFO: Saving data for WA10715: {'auction_closing_time': 1774716987.0, 'created_time': 1774557103.761216, 'last_price_update_time': 1774679458.333363}
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA10715') HTTP/1.1" 204 0
2026-03-28 06:30:58 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-28 06:30:58 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-28 06:30:58 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-28 06:30:58 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-28 06:30:58 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-28 06:30:58 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-28 06:30:58 [auto1.be] INFO: Scrape type for XJ95743: 2
2026-03-28 06:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-28 06:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd746447-b329-5819-9017-79b4d963625a with scrape type 2
2026-03-28 06:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd746447-b329-5819-9017-79b4d963625a with scrape type 2
2026-03-28 06:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd746447-b329-5819-9017-79b4d963625a, identifier: XJ95743
2026-03-28 06:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-28 06:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-28 06:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743 to the API
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:12:36Z',
 'fuel_type': 'diesel',
 'id': 'cd746447-b329-5819-9017-79b4d963625a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ95743',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 82671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-28 06:30:58 [auto1.be] INFO: Saving data for XJ95743: {'auction_closing_time': 1774714356.0, 'created_time': 1774557238.154345, 'last_price_update_time': 1774679458.740817}
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ95743') HTTP/1.1" 204 0
2026-03-28 06:30:58 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX12355%27 HTTP/1.1" 200 None
2026-03-28 06:30:58 [auto1.be] INFO: Scrape type for EX12355: 2
2026-03-28 06:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with identifier: EX12355
2026-03-28 06:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with scrape type 2
2026-03-28 06:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with scrape type 2
2026-03-28 06:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0, identifier: EX12355
2026-03-28 06:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with identifier: EX12355
2026-03-28 06:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with identifier: EX12355
2026-03-28 06:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with identifier: EX12355 to the API
2026-03-28 06:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:13:39Z',
 'fuel_type': 'diesel',
 'id': '2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX12355',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 137763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-11',
 'seller_name': None,
 'title': "Kia cee'd 1.4 CRDi Active",
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX12355%27 HTTP/1.1" 200 None
2026-03-28 06:30:59 [auto1.be] INFO: Saving data for EX12355: {'auction_closing_time': 1774714419.0, 'created_time': 1773133955.444827, 'last_price_update_time': 1774679459.172796}
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX12355') HTTP/1.1" 204 0
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB88275%27 HTTP/1.1" 200 None
2026-03-28 06:30:59 [auto1.be] INFO: Scrape type for LB88275: 0
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-28 06:30:59 [auto1.be] INFO: Scrape type for NB29078: 0
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC37293%27 HTTP/1.1" 200 None
2026-03-28 06:30:59 [auto1.be] INFO: Scrape type for VC37293: 0
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ44725%27 HTTP/1.1" 200 None
2026-03-28 06:30:59 [auto1.be] INFO: Scrape type for GJ44725: 0
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW09549%27 HTTP/1.1" 200 None
2026-03-28 06:30:59 [auto1.be] INFO: Scrape type for WW09549: 2
2026-03-28 06:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45a9c5f8-2c5f-57a8-b102-11fdb0b30738 with identifier: WW09549
2026-03-28 06:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45a9c5f8-2c5f-57a8-b102-11fdb0b30738 with scrape type 2
2026-03-28 06:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45a9c5f8-2c5f-57a8-b102-11fdb0b30738 with scrape type 2
2026-03-28 06:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45a9c5f8-2c5f-57a8-b102-11fdb0b30738, identifier: WW09549
2026-03-28 06:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45a9c5f8-2c5f-57a8-b102-11fdb0b30738 with identifier: WW09549
2026-03-28 06:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45a9c5f8-2c5f-57a8-b102-11fdb0b30738 with identifier: WW09549
2026-03-28 06:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45a9c5f8-2c5f-57a8-b102-11fdb0b30738 with identifier: WW09549 to the API
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:25:03Z',
 'fuel_type': 'diesel',
 'id': '45a9c5f8-2c5f-57a8-b102-11fdb0b30738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW09549',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'XLV',
 'odometer': 126888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Ssangyong XLV 1.6 TD Forward 4x2',
 'transmission': 'manual',
 'trim': 'Forward 4x2',
 'year': 2019}
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW09549%27 HTTP/1.1" 200 None
2026-03-28 06:30:59 [auto1.be] INFO: Saving data for WW09549: {'auction_closing_time': 1774715103.0, 'created_time': 1774471368.367725, 'last_price_update_time': 1774679459.675958}
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW09549') HTTP/1.1" 204 0
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-28 06:30:59 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-28 06:30:59 [auto1.be] INFO: Scrape type for VW32861: 0
2026-03-28 06:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:00 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT16310%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Scrape type for JT16310: 0
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ62896%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Scrape type for KZ62896: 0
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM94019%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Scrape type for PM94019: 2
2026-03-28 06:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee015c20-43d3-52d3-b2b0-12a056917b34 with identifier: PM94019
2026-03-28 06:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee015c20-43d3-52d3-b2b0-12a056917b34 with scrape type 2
2026-03-28 06:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee015c20-43d3-52d3-b2b0-12a056917b34 with scrape type 2
2026-03-28 06:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee015c20-43d3-52d3-b2b0-12a056917b34, identifier: PM94019
2026-03-28 06:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee015c20-43d3-52d3-b2b0-12a056917b34 with identifier: PM94019
2026-03-28 06:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee015c20-43d3-52d3-b2b0-12a056917b34 with identifier: PM94019
2026-03-28 06:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee015c20-43d3-52d3-b2b0-12a056917b34 with identifier: PM94019 to the API
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:49:40Z',
 'fuel_type': 'hybrid',
 'id': 'ee015c20-43d3-52d3-b2b0-12a056917b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM94019',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 87848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM94019%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Saving data for PM94019: {'auction_closing_time': 1774716580.0, 'created_time': 1774470997.050811, 'last_price_update_time': 1774679460.656703}
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM94019') HTTP/1.1" 204 0
2026-03-28 06:31:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Scrape type for YU72813: 0
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY96081%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Scrape type for FY96081: 0
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP72825%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Scrape type for CP72825: 0
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF72267%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Scrape type for YF72267: 0
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-28 06:31:00 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS35692%27 HTTP/1.1" 200 None
2026-03-28 06:31:00 [auto1.be] INFO: Scrape type for PS35692: 2
2026-03-28 06:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc644c7b-2492-5103-a329-445e8383d520 with identifier: PS35692
2026-03-28 06:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc644c7b-2492-5103-a329-445e8383d520 with scrape type 2
2026-03-28 06:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc644c7b-2492-5103-a329-445e8383d520 with scrape type 2
2026-03-28 06:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc644c7b-2492-5103-a329-445e8383d520, identifier: PS35692
2026-03-28 06:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc644c7b-2492-5103-a329-445e8383d520 with identifier: PS35692
2026-03-28 06:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc644c7b-2492-5103-a329-445e8383d520 with identifier: PS35692
2026-03-28 06:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc644c7b-2492-5103-a329-445e8383d520 with identifier: PS35692 to the API
2026-03-28 06:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:09:05Z',
 'fuel_type': 'petrol',
 'id': 'fc644c7b-2492-5103-a329-445e8383d520',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS35692',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 53282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-16',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS35692%27 HTTP/1.1" 200 None
2026-03-28 06:31:01 [auto1.be] INFO: Saving data for PS35692: {'auction_closing_time': 1774714145.0, 'created_time': 1773135355.685256, 'last_price_update_time': 1774679461.179624}
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS35692') HTTP/1.1" 204 0
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL54877%27 HTTP/1.1" 200 None
2026-03-28 06:31:01 [auto1.be] INFO: Scrape type for SL54877: 0
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-28 06:31:01 [auto1.be] INFO: Scrape type for CN29269: 2
2026-03-28 06:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-28 06:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with scrape type 2
2026-03-28 06:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with scrape type 2
2026-03-28 06:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4, identifier: CN29269
2026-03-28 06:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-28 06:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-28 06:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269 to the API
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:02:40Z',
 'fuel_type': 'diesel',
 'id': 'ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN29269',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 143734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-30',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-28 06:31:01 [auto1.be] INFO: Saving data for CN29269: {'auction_closing_time': 1774713760.0, 'created_time': 1774557184.009502, 'last_price_update_time': 1774679461.681631}
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN29269') HTTP/1.1" 204 0
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB01852%27 HTTP/1.1" 200 None
2026-03-28 06:31:01 [auto1.be] INFO: Scrape type for NB01852: 0
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-28 06:31:01 [auto1.be] INFO: Scrape type for KD01441: 0
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-28 06:31:01 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX70748%27 HTTP/1.1" 200 None
2026-03-28 06:31:01 [auto1.be] INFO: Scrape type for JX70748: 2
2026-03-28 06:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164a735a-8374-52ee-8ab2-4fea8f8ca2b2 with identifier: JX70748
2026-03-28 06:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164a735a-8374-52ee-8ab2-4fea8f8ca2b2 with scrape type 2
2026-03-28 06:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164a735a-8374-52ee-8ab2-4fea8f8ca2b2 with scrape type 2
2026-03-28 06:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 164a735a-8374-52ee-8ab2-4fea8f8ca2b2, identifier: JX70748
2026-03-28 06:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 164a735a-8374-52ee-8ab2-4fea8f8ca2b2 with identifier: JX70748
2026-03-28 06:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 164a735a-8374-52ee-8ab2-4fea8f8ca2b2 with identifier: JX70748
2026-03-28 06:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 164a735a-8374-52ee-8ab2-4fea8f8ca2b2 with identifier: JX70748 to the API
2026-03-28 06:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:14:32Z',
 'fuel_type': 'petrol',
 'id': '164a735a-8374-52ee-8ab2-4fea8f8ca2b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX70748',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 75146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Live XL',
 'transmission': 'manual',
 'trim': 'Live XL',
 'year': 2020}
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX70748%27 HTTP/1.1" 200 None
2026-03-28 06:31:02 [auto1.be] INFO: Saving data for JX70748: {'auction_closing_time': 1774714472.0, 'created_time': 1774557100.804063, 'last_price_update_time': 1774679462.143389}
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX70748') HTTP/1.1" 204 0
2026-03-28 06:31:02 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-28 06:31:02 [auto1.be] INFO: Scrape type for XD36076: 0
2026-03-28 06:31:02 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX12092%27 HTTP/1.1" 200 None
2026-03-28 06:31:02 [auto1.be] INFO: Scrape type for MX12092: 2
2026-03-28 06:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694b8c75-a381-522f-9f17-3baa6a844a3d with identifier: MX12092
2026-03-28 06:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694b8c75-a381-522f-9f17-3baa6a844a3d with scrape type 2
2026-03-28 06:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 694b8c75-a381-522f-9f17-3baa6a844a3d with scrape type 2
2026-03-28 06:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 694b8c75-a381-522f-9f17-3baa6a844a3d, identifier: MX12092
2026-03-28 06:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 694b8c75-a381-522f-9f17-3baa6a844a3d with identifier: MX12092
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 06:31:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 694b8c75-a381-522f-9f17-3baa6a844a3d with identifier: MX12092
2026-03-28 06:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 694b8c75-a381-522f-9f17-3baa6a844a3d with identifier: MX12092 to the API
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:51Z',
 'fuel_type': 'petrol',
 'id': '694b8c75-a381-522f-9f17-3baa6a844a3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX12092',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 136243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX12092%27 HTTP/1.1" 200 None
2026-03-28 06:31:02 [auto1.be] INFO: Saving data for MX12092: {'auction_closing_time': 1774716411.0, 'created_time': 1774557200.768106, 'last_price_update_time': 1774679462.777613}
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX12092') HTTP/1.1" 204 0
2026-03-28 06:31:02 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-28 06:31:02 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP88301%27 HTTP/1.1" 200 None
2026-03-28 06:31:02 [auto1.be] INFO: Scrape type for TP88301: 0
2026-03-28 06:31:02 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-28 06:31:02 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-28 06:31:02 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-28 06:31:02 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-28 06:31:02 [auto1.be] INFO: Scrape type for XV14848: 2
2026-03-28 06:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-28 06:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73768219-642a-599a-b543-150284d0217e with scrape type 2
2026-03-28 06:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73768219-642a-599a-b543-150284d0217e with scrape type 2
2026-03-28 06:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73768219-642a-599a-b543-150284d0217e, identifier: XV14848
2026-03-28 06:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-28 06:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-28 06:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848 to the API
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:29:23Z',
 'fuel_type': 'petrol',
 'id': '73768219-642a-599a-b543-150284d0217e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV14848',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 122829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-11',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2018}
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-28 06:31:03 [auto1.be] INFO: Saving data for XV14848: {'auction_closing_time': 1774715363.0, 'created_time': 1774557091.708332, 'last_price_update_time': 1774679463.197636}
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XV14848') HTTP/1.1" 204 0
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB86156%27 HTTP/1.1" 200 None
2026-03-28 06:31:03 [auto1.be] INFO: Scrape type for VB86156: 0
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV83812%27 HTTP/1.1" 200 None
2026-03-28 06:31:03 [auto1.be] INFO: Scrape type for HV83812: 0
2026-03-28 06:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:03 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-28 06:31:03 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-28 06:31:03 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-28 06:31:03 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-28 06:31:03 [auto1.be] INFO: Scrape type for VP75874: 2
2026-03-28 06:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with identifier: VP75874
2026-03-28 06:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with scrape type 2
2026-03-28 06:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with scrape type 2
2026-03-28 06:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08, identifier: VP75874
2026-03-28 06:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with identifier: VP75874
2026-03-28 06:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with identifier: VP75874
2026-03-28 06:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with identifier: VP75874 to the API
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:44:30Z',
 'fuel_type': 'petrol',
 'id': '5a839bea-ff22-5c6a-a4b4-c98ed66c4f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP75874',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 125938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2018}
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-28 06:31:03 [auto1.be] INFO: Saving data for VP75874: {'auction_closing_time': 1774716270.0, 'created_time': 1773131801.009921, 'last_price_update_time': 1774679463.973203}
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP75874') HTTP/1.1" 204 0
2026-03-28 06:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT50756%27 HTTP/1.1" 200 None
2026-03-28 06:31:04 [auto1.be] INFO: Scrape type for UT50756: 0
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM96172%27 HTTP/1.1" 200 None
2026-03-28 06:31:04 [auto1.be] INFO: Scrape type for ZM96172: 2
2026-03-28 06:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 494eb2a0-21e6-5d83-96c3-f8f0691d5c1d with identifier: ZM96172
2026-03-28 06:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 494eb2a0-21e6-5d83-96c3-f8f0691d5c1d with scrape type 2
2026-03-28 06:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 494eb2a0-21e6-5d83-96c3-f8f0691d5c1d with scrape type 2
2026-03-28 06:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 494eb2a0-21e6-5d83-96c3-f8f0691d5c1d, identifier: ZM96172
2026-03-28 06:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 494eb2a0-21e6-5d83-96c3-f8f0691d5c1d with identifier: ZM96172
2026-03-28 06:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 494eb2a0-21e6-5d83-96c3-f8f0691d5c1d with identifier: ZM96172
2026-03-28 06:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 494eb2a0-21e6-5d83-96c3-f8f0691d5c1d with identifier: ZM96172 to the API
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:00:41Z',
 'fuel_type': 'diesel',
 'id': '494eb2a0-21e6-5d83-96c3-f8f0691d5c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM96172',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 192333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-12',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM96172%27 HTTP/1.1" 200 None
2026-03-28 06:31:04 [auto1.be] INFO: Saving data for ZM96172: {'auction_closing_time': 1774713641.0, 'created_time': 1773134879.678579, 'last_price_update_time': 1774679464.534298}
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM96172') HTTP/1.1" 204 0
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP45390%27 HTTP/1.1" 200 None
2026-03-28 06:31:04 [auto1.be] INFO: Scrape type for TP45390: 2
2026-03-28 06:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2159230a-eb53-5e13-9a55-ff4c825edb9c with identifier: TP45390
2026-03-28 06:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2159230a-eb53-5e13-9a55-ff4c825edb9c with scrape type 2
2026-03-28 06:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2159230a-eb53-5e13-9a55-ff4c825edb9c with scrape type 2
2026-03-28 06:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2159230a-eb53-5e13-9a55-ff4c825edb9c, identifier: TP45390
2026-03-28 06:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2159230a-eb53-5e13-9a55-ff4c825edb9c with identifier: TP45390
2026-03-28 06:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2159230a-eb53-5e13-9a55-ff4c825edb9c with identifier: TP45390
2026-03-28 06:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2159230a-eb53-5e13-9a55-ff4c825edb9c with identifier: TP45390 to the API
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:24:05Z',
 'fuel_type': 'diesel',
 'id': '2159230a-eb53-5e13-9a55-ff4c825edb9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP45390',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 129518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-28',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP45390%27 HTTP/1.1" 200 None
2026-03-28 06:31:04 [auto1.be] INFO: Saving data for TP45390: {'auction_closing_time': 1774715045.0, 'created_time': 1773693900.683157, 'last_price_update_time': 1774679464.944398}
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TP45390') HTTP/1.1" 204 0
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS22519%27 HTTP/1.1" 200 None
2026-03-28 06:31:04 [auto1.be] INFO: Scrape type for FS22519: 0
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-28 06:31:04 [auto1.be] INFO: Scrape type for PM47313: 0
2026-03-28 06:31:04 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for FA19213: 2
2026-03-28 06:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with identifier: FA19213
2026-03-28 06:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with scrape type 2
2026-03-28 06:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with scrape type 2
2026-03-28 06:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8, identifier: FA19213
2026-03-28 06:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with identifier: FA19213
2026-03-28 06:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with identifier: FA19213
2026-03-28 06:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 93b6ac1e-3cc9-58eb-a262-f9485df11bb8 with identifier: FA19213 to the API
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:26Z',
 'fuel_type': 'diesel',
 'id': '93b6ac1e-3cc9-58eb-a262-f9485df11bb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA19213',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 222099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-31',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2015}
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Saving data for FA19213: {'auction_closing_time': 1774715786.0, 'created_time': 1773301680.922963, 'last_price_update_time': 1774679465.392281}
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA19213') HTTP/1.1" 204 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ45947%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for SJ45947: 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM22406%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for XM22406: 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for XF11904: 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC57902%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for WC57902: 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER60484%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for ER60484: 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB05626%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for MB05626: 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC10006%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for TC10006: 0
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-28 06:31:05 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ06807%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Scrape type for HZ06807: 2
2026-03-28 06:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a57597ef-21e4-5b07-8fa0-a54924cc7e60 with identifier: HZ06807
2026-03-28 06:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a57597ef-21e4-5b07-8fa0-a54924cc7e60 with scrape type 2
2026-03-28 06:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a57597ef-21e4-5b07-8fa0-a54924cc7e60 with scrape type 2
2026-03-28 06:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a57597ef-21e4-5b07-8fa0-a54924cc7e60, identifier: HZ06807
2026-03-28 06:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a57597ef-21e4-5b07-8fa0-a54924cc7e60 with identifier: HZ06807
2026-03-28 06:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a57597ef-21e4-5b07-8fa0-a54924cc7e60 with identifier: HZ06807
2026-03-28 06:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a57597ef-21e4-5b07-8fa0-a54924cc7e60 with identifier: HZ06807 to the API
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:32Z',
 'fuel_type': 'diesel',
 'id': 'a57597ef-21e4-5b07-8fa0-a54924cc7e60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ06807',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 182766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-14',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2015}
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ06807%27 HTTP/1.1" 200 None
2026-03-28 06:31:05 [auto1.be] INFO: Saving data for HZ06807: {'auction_closing_time': 1774713632.0, 'created_time': 1774557100.029454, 'last_price_update_time': 1774679465.952194}
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ06807') HTTP/1.1" 204 0
2026-03-28 06:31:06 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-28 06:31:06 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-28 06:31:06 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC70277%27 HTTP/1.1" 200 None
2026-03-28 06:31:06 [auto1.be] INFO: Scrape type for TC70277: 2
2026-03-28 06:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1962859a-a33e-5b60-abdf-fa45c377ff63 with identifier: TC70277
2026-03-28 06:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1962859a-a33e-5b60-abdf-fa45c377ff63 with scrape type 2
2026-03-28 06:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1962859a-a33e-5b60-abdf-fa45c377ff63 with scrape type 2
2026-03-28 06:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1962859a-a33e-5b60-abdf-fa45c377ff63, identifier: TC70277
2026-03-28 06:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1962859a-a33e-5b60-abdf-fa45c377ff63 with identifier: TC70277
2026-03-28 06:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1962859a-a33e-5b60-abdf-fa45c377ff63 with identifier: TC70277
2026-03-28 06:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1962859a-a33e-5b60-abdf-fa45c377ff63 with identifier: TC70277 to the API
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:21Z',
 'fuel_type': 'diesel',
 'id': '1962859a-a33e-5b60-abdf-fa45c377ff63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC70277',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 162263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seller_name': None,
 'title': 'BMW 3er 318d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC70277%27 HTTP/1.1" 200 None
2026-03-28 06:31:06 [auto1.be] INFO: Saving data for TC70277: {'auction_closing_time': 1774713981.0, 'created_time': 1773226420.582972, 'last_price_update_time': 1774679466.461255}
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC70277') HTTP/1.1" 204 0
2026-03-28 06:31:06 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45642%27 HTTP/1.1" 200 None
2026-03-28 06:31:06 [auto1.be] INFO: Scrape type for RB45642: 0
2026-03-28 06:31:06 [scrapy.extensions.logstats] INFO: Crawled 17 pages (at 17 pages/min), scraped 66 items (at 66 items/min)
2026-03-28 06:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-28 06:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:16 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:16 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-28 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-28 06:31:16 [auto1.be] INFO: Scrape type for HE95946: 2
2026-03-28 06:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-28 06:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956b7619-a748-5320-baf7-af177a9a6368 with scrape type 2
2026-03-28 06:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 956b7619-a748-5320-baf7-af177a9a6368 with scrape type 2
2026-03-28 06:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 956b7619-a748-5320-baf7-af177a9a6368, identifier: HE95946
2026-03-28 06:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 06:31:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-28 06:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946 to the API
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:02:32Z',
 'fuel_type': 'petrol',
 'id': '956b7619-a748-5320-baf7-af177a9a6368',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE95946',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-06',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-28 06:31:17 [auto1.be] INFO: Saving data for HE95946: {'auction_closing_time': 1774713752.0, 'created_time': 1774557207.996509, 'last_price_update_time': 1774679477.439344}
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE95946') HTTP/1.1" 204 0
2026-03-28 06:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD25511%27 HTTP/1.1" 200 None
2026-03-28 06:31:17 [auto1.be] INFO: Scrape type for AD25511: 0
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-28 06:31:17 [auto1.be] INFO: Scrape type for MB15920: 0
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN54564%27 HTTP/1.1" 200 None
2026-03-28 06:31:17 [auto1.be] INFO: Scrape type for MN54564: 0
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-28 06:31:17 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-28 06:31:17 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN55129%27 HTTP/1.1" 200 None
2026-03-28 06:31:17 [auto1.be] INFO: Scrape type for AN55129: 2
2026-03-28 06:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04485922-7170-5136-a990-dab3ba39afe1 with identifier: AN55129
2026-03-28 06:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04485922-7170-5136-a990-dab3ba39afe1 with scrape type 2
2026-03-28 06:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04485922-7170-5136-a990-dab3ba39afe1 with scrape type 2
2026-03-28 06:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 04485922-7170-5136-a990-dab3ba39afe1, identifier: AN55129
2026-03-28 06:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 04485922-7170-5136-a990-dab3ba39afe1 with identifier: AN55129
2026-03-28 06:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 04485922-7170-5136-a990-dab3ba39afe1 with identifier: AN55129
2026-03-28 06:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 04485922-7170-5136-a990-dab3ba39afe1 with identifier: AN55129 to the API
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:56:38Z',
 'fuel_type': 'diesel',
 'id': '04485922-7170-5136-a990-dab3ba39afe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN55129',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 132475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2018}
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN55129%27 HTTP/1.1" 200 None
2026-03-28 06:31:17 [auto1.be] INFO: Saving data for AN55129: {'auction_closing_time': 1774716998.0, 'created_time': 1774471384.390512, 'last_price_update_time': 1774679477.957399}
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AN55129') HTTP/1.1" 204 0
2026-03-28 06:31:18 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK17368%27 HTTP/1.1" 200 None
2026-03-28 06:31:18 [auto1.be] INFO: Scrape type for TK17368: 0
2026-03-28 06:31:18 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD47423%27 HTTP/1.1" 200 None
2026-03-28 06:31:18 [auto1.be] INFO: Scrape type for VD47423: 0
2026-03-28 06:31:18 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-28 06:31:18 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH31888%27 HTTP/1.1" 200 None
2026-03-28 06:31:18 [auto1.be] INFO: Scrape type for HH31888: 0
2026-03-28 06:31:18 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-28 06:31:18 [auto1.be] INFO: Scrape type for KK24955: 2
2026-03-28 06:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-28 06:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with scrape type 2
2026-03-28 06:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with scrape type 2
2026-03-28 06:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64, identifier: KK24955
2026-03-28 06:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-28 06:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-28 06:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955 to the API
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:40:31Z',
 'fuel_type': 'petrol',
 'id': '8559ff82-4084-5bd2-bddd-f93c8ed5cb64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK24955',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 166708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-17',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-28 06:31:18 [auto1.be] INFO: Saving data for KK24955: {'auction_closing_time': 1774716031.0, 'created_time': 1774557117.188305, 'last_price_update_time': 1774679478.567494}
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KK24955') HTTP/1.1" 204 0
2026-03-28 06:31:18 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-28 06:31:18 [auto1.be] INFO: Scrape type for UA82763: 2
2026-03-28 06:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-28 06:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311bae9a-b079-581b-b8c8-5dd42c88efda with scrape type 2
2026-03-28 06:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 311bae9a-b079-581b-b8c8-5dd42c88efda with scrape type 2
2026-03-28 06:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 311bae9a-b079-581b-b8c8-5dd42c88efda, identifier: UA82763
2026-03-28 06:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-28 06:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-28 06:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763 to the API
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:32Z',
 'fuel_type': 'petrol',
 'id': '311bae9a-b079-581b-b8c8-5dd42c88efda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA82763',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 105664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-28 06:31:19 [auto1.be] INFO: Saving data for UA82763: {'auction_closing_time': 1774715252.0, 'created_time': 1774557082.88172, 'last_price_update_time': 1774679479.004823}
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA82763') HTTP/1.1" 204 0
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-28 06:31:19 [auto1.be] INFO: Scrape type for RK42644: 0
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-28 06:31:19 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-28 06:31:19 [auto1.be] INFO: Scrape type for TS87931: 2
2026-03-28 06:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-28 06:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbd44f0-f880-5968-a846-3e3d6ebcd262 with scrape type 2
2026-03-28 06:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbd44f0-f880-5968-a846-3e3d6ebcd262 with scrape type 2
2026-03-28 06:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dbbd44f0-f880-5968-a846-3e3d6ebcd262, identifier: TS87931
2026-03-28 06:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-28 06:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-28 06:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931 to the API
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:15:35Z',
 'fuel_type': 'hybrid',
 'id': 'dbbd44f0-f880-5968-a846-3e3d6ebcd262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS87931',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 172125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-28 06:31:19 [auto1.be] INFO: Saving data for TS87931: {'auction_closing_time': 1774714535.0, 'created_time': 1774557200.352614, 'last_price_update_time': 1774679479.474578}
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS87931') HTTP/1.1" 204 0
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF82058%27 HTTP/1.1" 200 None
2026-03-28 06:31:19 [auto1.be] INFO: Scrape type for VF82058: 0
2026-03-28 06:31:19 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-28 06:31:19 [auto1.be] INFO: Scrape type for FP68376: 2
2026-03-28 06:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-28 06:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with scrape type 2
2026-03-28 06:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with scrape type 2
2026-03-28 06:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf, identifier: FP68376
2026-03-28 06:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-28 06:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-28 06:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376 to the API
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:25:31Z',
 'fuel_type': 'petrol',
 'id': '35d200c7-af14-5a63-a9e3-ba5a9a838fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP68376',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 117701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-12',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2015}
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-28 06:31:19 [auto1.be] INFO: Saving data for FP68376: {'auction_closing_time': 1774715131.0, 'created_time': 1774557189.746164, 'last_price_update_time': 1774679479.986922}
2026-03-28 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP68376') HTTP/1.1" 204 0
2026-03-28 06:31:20 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 06:31:20 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-28 06:31:20 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC58285%27 HTTP/1.1" 200 None
2026-03-28 06:31:20 [auto1.be] INFO: Scrape type for EC58285: 2
2026-03-28 06:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57836e0f-64f6-5867-abd0-02bd6f681806 with identifier: EC58285
2026-03-28 06:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57836e0f-64f6-5867-abd0-02bd6f681806 with scrape type 2
2026-03-28 06:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57836e0f-64f6-5867-abd0-02bd6f681806 with scrape type 2
2026-03-28 06:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 57836e0f-64f6-5867-abd0-02bd6f681806, identifier: EC58285
2026-03-28 06:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 57836e0f-64f6-5867-abd0-02bd6f681806 with identifier: EC58285
2026-03-28 06:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 57836e0f-64f6-5867-abd0-02bd6f681806 with identifier: EC58285
2026-03-28 06:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 57836e0f-64f6-5867-abd0-02bd6f681806 with identifier: EC58285 to the API
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:00:02Z',
 'fuel_type': 'petrol',
 'id': '57836e0f-64f6-5867-abd0-02bd6f681806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC58285',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 86175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2013}
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC58285%27 HTTP/1.1" 200 None
2026-03-28 06:31:20 [auto1.be] INFO: Saving data for EC58285: {'auction_closing_time': 1774713602.0, 'created_time': 1774471316.989923, 'last_price_update_time': 1774679480.408243}
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EC58285') HTTP/1.1" 204 0
2026-03-28 06:31:20 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-28 06:31:20 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-28 06:31:20 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-28 06:31:20 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-28 06:31:20 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-28 06:31:20 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-28 06:31:20 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR73275%27 HTTP/1.1" 200 None
2026-03-28 06:31:20 [auto1.be] INFO: Scrape type for UR73275: 2
2026-03-28 06:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 086c5991-96c6-53ed-8883-7f943d000c96 with identifier: UR73275
2026-03-28 06:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 086c5991-96c6-53ed-8883-7f943d000c96 with scrape type 2
2026-03-28 06:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 086c5991-96c6-53ed-8883-7f943d000c96 with scrape type 2
2026-03-28 06:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 086c5991-96c6-53ed-8883-7f943d000c96, identifier: UR73275
2026-03-28 06:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 086c5991-96c6-53ed-8883-7f943d000c96 with identifier: UR73275
2026-03-28 06:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 086c5991-96c6-53ed-8883-7f943d000c96 with identifier: UR73275
2026-03-28 06:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 086c5991-96c6-53ed-8883-7f943d000c96 with identifier: UR73275 to the API
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:48Z',
 'fuel_type': 'diesel',
 'id': '086c5991-96c6-53ed-8883-7f943d000c96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR73275',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 92742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-10',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline FWD',
 'transmission': 'automatic',
 'trim': 'Trendline FWD',
 'year': 2021}
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR73275%27 HTTP/1.1" 200 None
2026-03-28 06:31:20 [auto1.be] INFO: Saving data for UR73275: {'auction_closing_time': 1774717068.0, 'created_time': 1774557226.735661, 'last_price_update_time': 1774679480.861573}
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR73275') HTTP/1.1" 204 0
2026-03-28 06:31:20 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-28 06:31:20 [auto1.be] INFO: Scrape type for RF74485: 2
2026-03-28 06:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-28 06:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893943d4-e5ea-5829-8278-50cb4a6de35c with scrape type 2
2026-03-28 06:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 893943d4-e5ea-5829-8278-50cb4a6de35c with scrape type 2
2026-03-28 06:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 893943d4-e5ea-5829-8278-50cb4a6de35c, identifier: RF74485
2026-03-28 06:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-28 06:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-28 06:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485 to the API
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:04:49Z',
 'fuel_type': 'petrol',
 'id': '893943d4-e5ea-5829-8278-50cb4a6de35c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF74485',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 120277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-18',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2010}
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-28 06:31:21 [auto1.be] INFO: Saving data for RF74485: {'auction_closing_time': 1774713889.0, 'created_time': 1774557124.322943, 'last_price_update_time': 1774679481.375517}
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RF74485') HTTP/1.1" 204 0
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM59718%27 HTTP/1.1" 200 None
2026-03-28 06:31:21 [auto1.be] INFO: Scrape type for ZM59718: 0
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-28 06:31:21 [auto1.be] INFO: Scrape type for HT59149: 0
2026-03-28 06:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:21 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-28 06:31:21 [auto1.be] INFO: Scrape type for FW88759: 2
2026-03-28 06:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-28 06:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9935248-4413-5eec-a9b4-2094f8739f77 with scrape type 2
2026-03-28 06:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9935248-4413-5eec-a9b4-2094f8739f77 with scrape type 2
2026-03-28 06:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9935248-4413-5eec-a9b4-2094f8739f77, identifier: FW88759
2026-03-28 06:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-28 06:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-28 06:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759 to the API
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:01:24Z',
 'fuel_type': 'diesel',
 'id': 'a9935248-4413-5eec-a9b4-2094f8739f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW88759',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 119748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-28 06:31:21 [auto1.be] INFO: Saving data for FW88759: {'auction_closing_time': 1774713684.0, 'created_time': 1774557249.17155, 'last_price_update_time': 1774679481.97543}
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FW88759') HTTP/1.1" 204 0
2026-03-28 06:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:21 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN52312%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for HN52312: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA69556%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for CA69556: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP57356%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for BP57356: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET01802%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for ET01802: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD53912%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for SD53912: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW10235%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for YW10235: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS53866%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for MS53866: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG15817%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for WG15817: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA16064%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for JA16064: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU85415%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for JU85415: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF20284%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for BF20284: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY76075%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for BY76075: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for UE43146: 0
2026-03-28 06:31:22 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-28 06:31:22 [auto1.be] INFO: Scrape type for MU18005: 2
2026-03-28 06:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-28 06:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with scrape type 2
2026-03-28 06:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with scrape type 2
2026-03-28 06:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11, identifier: MU18005
2026-03-28 06:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-28 06:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-28 06:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005 to the API
2026-03-28 06:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:20Z',
 'fuel_type': 'diesel',
 'id': 'ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU18005',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 162262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2016}
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-28 06:31:23 [auto1.be] INFO: Saving data for MU18005: {'auction_closing_time': 1774713860.0, 'created_time': 1774557170.686852, 'last_price_update_time': 1774679483.266062}
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MU18005') HTTP/1.1" 204 0
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-28 06:31:23 [auto1.be] INFO: Scrape type for NG50909: 0
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT25813%27 HTTP/1.1" 200 None
2026-03-28 06:31:23 [auto1.be] INFO: Scrape type for JT25813: 0
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-28 06:31:23 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV14945%27 HTTP/1.1" 200 None
2026-03-28 06:31:23 [auto1.be] INFO: Scrape type for TV14945: 2
2026-03-28 06:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d22662ad-700d-5adf-a149-2858ae05b561 with identifier: TV14945
2026-03-28 06:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d22662ad-700d-5adf-a149-2858ae05b561 with scrape type 2
2026-03-28 06:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d22662ad-700d-5adf-a149-2858ae05b561 with scrape type 2
2026-03-28 06:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d22662ad-700d-5adf-a149-2858ae05b561, identifier: TV14945
2026-03-28 06:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d22662ad-700d-5adf-a149-2858ae05b561 with identifier: TV14945
2026-03-28 06:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d22662ad-700d-5adf-a149-2858ae05b561 with identifier: TV14945
2026-03-28 06:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d22662ad-700d-5adf-a149-2858ae05b561 with identifier: TV14945 to the API
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:08:44Z',
 'fuel_type': 'petrol',
 'id': 'd22662ad-700d-5adf-a149-2858ae05b561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV14945',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 47719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-21',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV14945%27 HTTP/1.1" 200 None
2026-03-28 06:31:23 [auto1.be] INFO: Saving data for TV14945: {'auction_closing_time': 1774714124.0, 'created_time': 1774471178.821246, 'last_price_update_time': 1774679483.894683}
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV14945') HTTP/1.1" 204 0
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-28 06:31:23 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-28 06:31:23 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-28 06:31:23 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-28 06:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:25 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:25 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-28 06:31:25 [auto1.be] INFO: Scrape type for ZP07177: 2
2026-03-28 06:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-28 06:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69765ded-891c-5b27-a92d-03388c67e8a7 with scrape type 2
2026-03-28 06:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69765ded-891c-5b27-a92d-03388c67e8a7 with scrape type 2
2026-03-28 06:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69765ded-891c-5b27-a92d-03388c67e8a7, identifier: ZP07177
2026-03-28 06:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-28 06:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-28 06:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177 to the API
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:25:42Z',
 'fuel_type': 'petrol',
 'id': '69765ded-891c-5b27-a92d-03388c67e8a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP07177',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 123075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-01',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-28 06:31:25 [auto1.be] INFO: Saving data for ZP07177: {'auction_closing_time': 1774715142.0, 'created_time': 1774557181.691529, 'last_price_update_time': 1774679485.95679}
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP07177') HTTP/1.1" 204 0
2026-03-28 06:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:25 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-28 06:31:25 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-28 06:31:25 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-28 06:31:25 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-28 06:31:25 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ28865%27 HTTP/1.1" 200 None
2026-03-28 06:31:25 [auto1.be] INFO: Scrape type for WJ28865: 0
2026-03-28 06:31:25 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA78346%27 HTTP/1.1" 200 None
2026-03-28 06:31:26 [auto1.be] INFO: Scrape type for SA78346: 0
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59251%27 HTTP/1.1" 200 None
2026-03-28 06:31:26 [auto1.be] INFO: Scrape type for HB59251: 0
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: YS62292
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS62292%27 HTTP/1.1" 200 None
2026-03-28 06:31:26 [auto1.be] INFO: Scrape type for YS62292: 0
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-28 06:31:26 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ19137%27 HTTP/1.1" 200 None
2026-03-28 06:31:26 [auto1.be] INFO: Scrape type for PZ19137: 0
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU16802%27 HTTP/1.1" 200 None
2026-03-28 06:31:26 [auto1.be] INFO: Scrape type for BU16802: 2
2026-03-28 06:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with identifier: BU16802
2026-03-28 06:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with scrape type 2
2026-03-28 06:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with scrape type 2
2026-03-28 06:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3, identifier: BU16802
2026-03-28 06:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with identifier: BU16802
2026-03-28 06:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with identifier: BU16802
2026-03-28 06:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with identifier: BU16802 to the API
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:41:42Z',
 'fuel_type': 'diesel',
 'id': '6d89b93a-ed8b-5a64-bf49-157e2abd16c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU16802',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 147833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seller_name': None,
 'title': 'Ford Puma 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU16802%27 HTTP/1.1" 200 None
2026-03-28 06:31:26 [auto1.be] INFO: Saving data for BU16802: {'auction_closing_time': 1774716102.0, 'created_time': 1773136926.063095, 'last_price_update_time': 1774679486.861107}
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU16802') HTTP/1.1" 204 0
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-28 06:31:26 [auto1.be] INFO: Scrape type for CS98471: 0
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-28 06:31:26 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Scrape type for RB53949: 2
2026-03-28 06:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-28 06:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31cfe75-b57a-50f3-b353-36dc0366f07b with scrape type 2
2026-03-28 06:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b31cfe75-b57a-50f3-b353-36dc0366f07b with scrape type 2
2026-03-28 06:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b31cfe75-b57a-50f3-b353-36dc0366f07b, identifier: RB53949
2026-03-28 06:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-28 06:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-28 06:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949 to the API
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:21:42Z',
 'fuel_type': 'hybrid',
 'id': 'b31cfe75-b57a-50f3-b353-36dc0366f07b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB53949',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 127220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-26',
 'seller_name': None,
 'title': 'BMW 3er 320e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Saving data for RB53949: {'auction_closing_time': 1774714902.0, 'created_time': 1774557226.265258, 'last_price_update_time': 1774679487.378423}
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB53949') HTTP/1.1" 204 0
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB84163%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Scrape type for LB84163: 0
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG51748%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Scrape type for XG51748: 0
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: UM09750
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP96232%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Scrape type for WP96232: 0
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP29569%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Scrape type for XP29569: 0
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Scrape type for HS59761: 0
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Scrape type for SD69002: 0
2026-03-28 06:31:27 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Scrape type for RK05604: 2
2026-03-28 06:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-28 06:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30c28b3-8de6-5b14-9f0d-0220db214618 with scrape type 2
2026-03-28 06:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f30c28b3-8de6-5b14-9f0d-0220db214618 with scrape type 2
2026-03-28 06:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f30c28b3-8de6-5b14-9f0d-0220db214618, identifier: RK05604
2026-03-28 06:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-28 06:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-28 06:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604 to the API
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:21:29Z',
 'fuel_type': 'diesel',
 'id': 'f30c28b3-8de6-5b14-9f0d-0220db214618',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK05604',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 142442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-28 06:31:27 [auto1.be] INFO: Saving data for RK05604: {'auction_closing_time': 1774714889.0, 'created_time': 1774557247.97669, 'last_price_update_time': 1774679487.921818}
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK05604') HTTP/1.1" 204 0
2026-03-28 06:31:28 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-28 06:31:28 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-28 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-28 06:31:28 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-28 06:31:28 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-28 06:31:28 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-28 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-28 06:31:28 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-28 06:31:28 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-28 06:31:28 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-28 06:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:29 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:29 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-28 06:31:29 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-28 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-28 06:31:29 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-28 06:31:29 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-28 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-28 06:31:29 [auto1.be] INFO: Scrape type for XC10139: 2
2026-03-28 06:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-28 06:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b722d821-e14d-539a-8136-ef63786faded with scrape type 2
2026-03-28 06:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b722d821-e14d-539a-8136-ef63786faded with scrape type 2
2026-03-28 06:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b722d821-e14d-539a-8136-ef63786faded, identifier: XC10139
2026-03-28 06:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-28 06:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:31:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 06:31:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-28 06:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139 to the API
2026-03-28 06:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:11:44Z',
 'fuel_type': 'diesel',
 'id': 'b722d821-e14d-539a-8136-ef63786faded',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC10139',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 119578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-28 06:31:30 [auto1.be] INFO: Saving data for XC10139: {'auction_closing_time': 1774714304.0, 'created_time': 1774557184.94311, 'last_price_update_time': 1774679490.313991}
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC10139') HTTP/1.1" 204 0
2026-03-28 06:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:30 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-28 06:31:30 [auto1.be] INFO: Scrape type for DF44974: 2
2026-03-28 06:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-28 06:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3918341-d117-5a76-a190-c0d113d723e8 with scrape type 2
2026-03-28 06:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3918341-d117-5a76-a190-c0d113d723e8 with scrape type 2
2026-03-28 06:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3918341-d117-5a76-a190-c0d113d723e8, identifier: DF44974
2026-03-28 06:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-28 06:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-28 06:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974 to the API
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:49Z',
 'fuel_type': 'diesel',
 'id': 'c3918341-d117-5a76-a190-c0d113d723e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF44974',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 128495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-01',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ultra',
 'transmission': 'manual',
 'trim': 'Ultra',
 'year': 2016}
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-28 06:31:30 [auto1.be] INFO: Saving data for DF44974: {'auction_closing_time': 1774716709.0, 'created_time': 1774557241.034083, 'last_price_update_time': 1774679490.737249}
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF44974') HTTP/1.1" 204 0
2026-03-28 06:31:30 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-28 06:31:30 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD62634%27 HTTP/1.1" 200 None
2026-03-28 06:31:30 [auto1.be] INFO: Scrape type for SD62634: 0
2026-03-28 06:31:30 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP33108%27 HTTP/1.1" 200 None
2026-03-28 06:31:30 [auto1.be] INFO: Scrape type for FP33108: 0
2026-03-28 06:31:30 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-28 06:31:30 [auto1.be] INFO: Scrape type for GS48835: 2
2026-03-28 06:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-28 06:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 760ce312-37f0-5970-81ce-221075de60ae with scrape type 2
2026-03-28 06:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 760ce312-37f0-5970-81ce-221075de60ae with scrape type 2
2026-03-28 06:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 760ce312-37f0-5970-81ce-221075de60ae, identifier: GS48835
2026-03-28 06:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-28 06:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-28 06:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835 to the API
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:12:50Z',
 'fuel_type': 'diesel',
 'id': '760ce312-37f0-5970-81ce-221075de60ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS48835',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 167666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2019}
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-28 06:31:31 [auto1.be] INFO: Saving data for GS48835: {'auction_closing_time': 1774714370.0, 'created_time': 1774557163.944948, 'last_price_update_time': 1774679491.397502}
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS48835') HTTP/1.1" 204 0
2026-03-28 06:31:31 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-28 06:31:31 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-28 06:31:31 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-28 06:31:31 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM99520%27 HTTP/1.1" 200 None
2026-03-28 06:31:31 [auto1.be] INFO: Scrape type for RM99520: 0
2026-03-28 06:31:31 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY81530%27 HTTP/1.1" 200 None
2026-03-28 06:31:31 [auto1.be] INFO: Scrape type for CY81530: 0
2026-03-28 06:31:31 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-28 06:31:31 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-28 06:31:31 [auto1.be] INFO: Scrape type for HP15544: 2
2026-03-28 06:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-28 06:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with scrape type 2
2026-03-28 06:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with scrape type 2
2026-03-28 06:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56e4ca33-c073-51a0-b1d9-e895a5b9af41, identifier: HP15544
2026-03-28 06:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-28 06:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-28 06:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544 to the API
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:55:24Z',
 'fuel_type': 'diesel',
 'id': '56e4ca33-c073-51a0-b1d9-e895a5b9af41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP15544',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 116128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-09',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM B-Tech',
 'transmission': 'automatic',
 'trim': 'B-Tech',
 'year': 2020}
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Saving data for HP15544: {'auction_closing_time': 1774716924.0, 'created_time': 1774557097.753026, 'last_price_update_time': 1774679492.033794}
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP15544') HTTP/1.1" 204 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY02593%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for VY02593: 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK96372%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for HK96372: 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN36947%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for SN36947: 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for WW33850: 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for NA83535: 2
2026-03-28 06:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1364a632-aecb-50d4-99d0-9289ab0edaf7 with identifier: NA83535
2026-03-28 06:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1364a632-aecb-50d4-99d0-9289ab0edaf7 with scrape type 2
2026-03-28 06:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1364a632-aecb-50d4-99d0-9289ab0edaf7 with scrape type 2
2026-03-28 06:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1364a632-aecb-50d4-99d0-9289ab0edaf7, identifier: NA83535
2026-03-28 06:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1364a632-aecb-50d4-99d0-9289ab0edaf7 with identifier: NA83535
2026-03-28 06:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1364a632-aecb-50d4-99d0-9289ab0edaf7 with identifier: NA83535
2026-03-28 06:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1364a632-aecb-50d4-99d0-9289ab0edaf7 with identifier: NA83535 to the API
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:02Z',
 'fuel_type': 'diesel',
 'id': '1364a632-aecb-50d4-99d0-9289ab0edaf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA83535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 183738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2017}
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Saving data for NA83535: {'auction_closing_time': 1774715582.0, 'created_time': 1773136093.690635, 'last_price_update_time': 1774679492.825802}
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NA83535') HTTP/1.1" 204 0
2026-03-28 06:31:32 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-28 06:31:32 [auto1.be] INFO: Scrape type for RW15578: 2
2026-03-28 06:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-28 06:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73abd779-7569-5cae-994d-decd1e37cc99 with scrape type 2
2026-03-28 06:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73abd779-7569-5cae-994d-decd1e37cc99 with scrape type 2
2026-03-28 06:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73abd779-7569-5cae-994d-decd1e37cc99, identifier: RW15578
2026-03-28 06:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-28 06:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-28 06:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578 to the API
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:27:28Z',
 'fuel_type': 'petrol',
 'id': '73abd779-7569-5cae-994d-decd1e37cc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW15578',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 100923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'Opel Combo 1.4 Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2011}
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-28 06:31:33 [auto1.be] INFO: Saving data for RW15578: {'auction_closing_time': 1774715248.0, 'created_time': 1774557230.269752, 'last_price_update_time': 1774679493.335365}
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW15578') HTTP/1.1" 204 0
2026-03-28 06:31:33 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR56300%27 HTTP/1.1" 200 None
2026-03-28 06:31:33 [auto1.be] INFO: Scrape type for MR56300: 0
2026-03-28 06:31:33 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-28 06:31:33 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-28 06:31:33 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-28 06:31:33 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-28 06:31:33 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-28 06:31:33 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50004%27 HTTP/1.1" 200 None
2026-03-28 06:31:33 [auto1.be] INFO: Scrape type for TX50004: 0
2026-03-28 06:31:33 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-28 06:31:33 [auto1.be] INFO: Found listing with ID: FK81343
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK81343%27 HTTP/1.1" 200 None
2026-03-28 06:31:33 [auto1.be] INFO: Scrape type for FK81343: 0
2026-03-28 06:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:34 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:34 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-28 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-28 06:31:34 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-28 06:31:34 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-28 06:31:34 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-28 06:31:34 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-28 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-28 06:31:34 [auto1.be] INFO: Scrape type for WC10504: 2
2026-03-28 06:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-28 06:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dff6dc5-220c-5482-a920-fa14a7a119fe with scrape type 2
2026-03-28 06:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dff6dc5-220c-5482-a920-fa14a7a119fe with scrape type 2
2026-03-28 06:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5dff6dc5-220c-5482-a920-fa14a7a119fe, identifier: WC10504
2026-03-28 06:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-28 06:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-28 06:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504 to the API
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:19:45Z',
 'fuel_type': 'diesel',
 'id': '5dff6dc5-220c-5482-a920-fa14a7a119fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC10504',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 268796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-19',
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi Active Adventure',
 'transmission': 'manual',
 'trim': 'Active Adventure',
 'year': 2008}
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-28 06:31:35 [auto1.be] INFO: Saving data for WC10504: {'auction_closing_time': 1774714785.0, 'created_time': 1774557240.030861, 'last_price_update_time': 1774679495.785944}
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC10504') HTTP/1.1" 204 0
2026-03-28 06:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:35 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF97683%27 HTTP/1.1" 200 None
2026-03-28 06:31:35 [auto1.be] INFO: Scrape type for VF97683: 0
2026-03-28 06:31:35 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ67143%27 HTTP/1.1" 200 None
2026-03-28 06:31:35 [auto1.be] INFO: Scrape type for RZ67143: 0
2026-03-28 06:31:35 [auto1.be] INFO: Found listing with ID: FL89669
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL89669%27 HTTP/1.1" 200 None
2026-03-28 06:31:35 [auto1.be] INFO: Scrape type for FL89669: 0
2026-03-28 06:31:35 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-28 06:31:35 [auto1.be] INFO: Scrape type for HJ68089: 2
2026-03-28 06:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b2fefb-512c-5ecb-81eb-4134a7a5035f with identifier: HJ68089
2026-03-28 06:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b2fefb-512c-5ecb-81eb-4134a7a5035f with scrape type 2
2026-03-28 06:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26b2fefb-512c-5ecb-81eb-4134a7a5035f with scrape type 2
2026-03-28 06:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 26b2fefb-512c-5ecb-81eb-4134a7a5035f, identifier: HJ68089
2026-03-28 06:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 26b2fefb-512c-5ecb-81eb-4134a7a5035f with identifier: HJ68089
2026-03-28 06:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 26b2fefb-512c-5ecb-81eb-4134a7a5035f with identifier: HJ68089
2026-03-28 06:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 26b2fefb-512c-5ecb-81eb-4134a7a5035f with identifier: HJ68089 to the API
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:49:37Z',
 'fuel_type': 'diesel',
 'id': '26b2fefb-512c-5ecb-81eb-4134a7a5035f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ68089',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 197143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Saving data for HJ68089: {'auction_closing_time': 1774716577.0, 'created_time': 1773132521.536557, 'last_price_update_time': 1774679496.38462}
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ68089') HTTP/1.1" 204 0
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Scrape type for MS70949: 0
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: US70780
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US70780%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Scrape type for US70780: 0
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE21271%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Scrape type for LE21271: 0
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL17745%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Scrape type for LL17745: 0
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Scrape type for GG92230: 0
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-28 06:31:36 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM55843%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Scrape type for CM55843: 2
2026-03-28 06:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eb73a80-660e-55c5-9c81-44e2f75df7ef with identifier: CM55843
2026-03-28 06:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eb73a80-660e-55c5-9c81-44e2f75df7ef with scrape type 2
2026-03-28 06:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eb73a80-660e-55c5-9c81-44e2f75df7ef with scrape type 2
2026-03-28 06:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6eb73a80-660e-55c5-9c81-44e2f75df7ef, identifier: CM55843
2026-03-28 06:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6eb73a80-660e-55c5-9c81-44e2f75df7ef with identifier: CM55843
2026-03-28 06:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6eb73a80-660e-55c5-9c81-44e2f75df7ef with identifier: CM55843
2026-03-28 06:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6eb73a80-660e-55c5-9c81-44e2f75df7ef with identifier: CM55843 to the API
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:01Z',
 'fuel_type': 'diesel',
 'id': '6eb73a80-660e-55c5-9c81-44e2f75df7ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM55843',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 215865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-13',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Sd4 Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2014}
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM55843%27 HTTP/1.1" 200 None
2026-03-28 06:31:36 [auto1.be] INFO: Saving data for CM55843: {'auction_closing_time': 1774714861.0, 'created_time': 1773131869.197768, 'last_price_update_time': 1774679496.95054}
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM55843') HTTP/1.1" 204 0
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA14466%27 HTTP/1.1" 200 None
2026-03-28 06:31:37 [auto1.be] INFO: Scrape type for AA14466: 0
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS61863%27 HTTP/1.1" 200 None
2026-03-28 06:31:37 [auto1.be] INFO: Scrape type for JS61863: 0
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ85146%27 HTTP/1.1" 200 None
2026-03-28 06:31:37 [auto1.be] INFO: Scrape type for HJ85146: 0
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-28 06:31:37 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: CB51818
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB51818%27 HTTP/1.1" 200 None
2026-03-28 06:31:37 [auto1.be] INFO: Scrape type for CB51818: 0
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH75684%27 HTTP/1.1" 200 None
2026-03-28 06:31:37 [auto1.be] INFO: Scrape type for CH75684: 0
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-28 06:31:37 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-28 06:31:37 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-28 06:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:38 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP12382%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for WP12382: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC89583%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for YC89583: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for SU72836: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB71990%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for XB71990: 2
2026-03-28 06:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34bba60e-420f-501d-b83c-fefed2971ef2 with identifier: XB71990
2026-03-28 06:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34bba60e-420f-501d-b83c-fefed2971ef2 with scrape type 2
2026-03-28 06:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34bba60e-420f-501d-b83c-fefed2971ef2 with scrape type 2
2026-03-28 06:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34bba60e-420f-501d-b83c-fefed2971ef2, identifier: XB71990
2026-03-28 06:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34bba60e-420f-501d-b83c-fefed2971ef2 with identifier: XB71990
2026-03-28 06:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34bba60e-420f-501d-b83c-fefed2971ef2 with identifier: XB71990
2026-03-28 06:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34bba60e-420f-501d-b83c-fefed2971ef2 with identifier: XB71990 to the API
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:37:19Z',
 'fuel_type': 'diesel',
 'id': '34bba60e-420f-501d-b83c-fefed2971ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB71990',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 357827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI Extralang',
 'transmission': 'automatic',
 'trim': 'Extralang',
 'year': 2019}
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB71990%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Saving data for XB71990: {'auction_closing_time': 1774715839.0, 'created_time': 1773138060.736419, 'last_price_update_time': 1774679498.677023}
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB71990') HTTP/1.1" 204 0
2026-03-28 06:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE75068%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for JE75068: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB16456%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for EB16456: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU07402%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for EU07402: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK96520%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for YK96520: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ88717%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for UJ88717: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-28 06:31:38 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-28 06:31:38 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-28 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT89669%27 HTTP/1.1" 200 None
2026-03-28 06:31:39 [auto1.be] INFO: Scrape type for TT89669: 0
2026-03-28 06:31:39 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-28 06:31:39 [auto1.be] INFO: Scrape type for CF04837: 2
2026-03-28 06:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-28 06:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with scrape type 2
2026-03-28 06:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with scrape type 2
2026-03-28 06:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0, identifier: CF04837
2026-03-28 06:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-28 06:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-28 06:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837 to the API
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:14:08Z',
 'fuel_type': 'hybrid',
 'id': '30986abb-ad7c-5ee6-95f7-7b9cf351f8c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF04837',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 54083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-11',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2021}
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-28 06:31:39 [auto1.be] INFO: Saving data for CF04837: {'auction_closing_time': 1774714448.0, 'created_time': 1774557210.236662, 'last_price_update_time': 1774679499.404838}
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CF04837') HTTP/1.1" 204 0
2026-03-28 06:31:39 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-28 06:31:39 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-28 06:31:39 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-28 06:31:39 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-28 06:31:39 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91867%27 HTTP/1.1" 200 None
2026-03-28 06:31:39 [auto1.be] INFO: Scrape type for CP91867: 0
2026-03-28 06:31:39 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-28 06:31:39 [auto1.be] INFO: Scrape type for GR78986: 2
2026-03-28 06:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-28 06:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78187941-5f25-5bbe-9615-e404d832696b with scrape type 2
2026-03-28 06:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78187941-5f25-5bbe-9615-e404d832696b with scrape type 2
2026-03-28 06:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78187941-5f25-5bbe-9615-e404d832696b, identifier: GR78986
2026-03-28 06:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-28 06:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-28 06:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986 to the API
2026-03-28 06:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:23:17Z',
 'fuel_type': 'hybrid',
 'id': '78187941-5f25-5bbe-9615-e404d832696b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR78986',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 81537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Saving data for GR78986: {'auction_closing_time': 1774714997.0, 'created_time': 1774557247.275806, 'last_price_update_time': 1774679500.288379}
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GR78986') HTTP/1.1" 204 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV43116%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for DV43116: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36562%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for UA36562: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for KV94769: 2
2026-03-28 06:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-28 06:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9bc0b34-3b35-5969-bb19-c15d82005856 with scrape type 2
2026-03-28 06:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9bc0b34-3b35-5969-bb19-c15d82005856 with scrape type 2
2026-03-28 06:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d9bc0b34-3b35-5969-bb19-c15d82005856, identifier: KV94769
2026-03-28 06:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-28 06:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-28 06:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769 to the API
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:04:19Z',
 'fuel_type': 'diesel',
 'id': 'd9bc0b34-3b35-5969-bb19-c15d82005856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV94769',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-03',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2023}
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Saving data for KV94769: {'auction_closing_time': 1774713859.0, 'created_time': 1774557227.408771, 'last_price_update_time': 1774679500.714369}
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV94769') HTTP/1.1" 204 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF07146%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for CF07146: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ15610%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for GJ15610: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG19472%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for MG19472: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for KP16725: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR50383%27 HTTP/1.1" 200 None
2026-03-28 06:31:40 [auto1.be] INFO: Scrape type for MR50383: 0
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-28 06:31:40 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-28 06:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:41 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:41 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-28 06:31:41 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-28 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ37622%27 HTTP/1.1" 200 None
2026-03-28 06:31:41 [auto1.be] INFO: Scrape type for VZ37622: 0
2026-03-28 06:31:41 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-28 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM48533%27 HTTP/1.1" 200 None
2026-03-28 06:31:41 [auto1.be] INFO: Scrape type for NM48533: 2
2026-03-28 06:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477b42d0-3310-57c6-84df-6dd23e206805 with identifier: NM48533
2026-03-28 06:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477b42d0-3310-57c6-84df-6dd23e206805 with scrape type 2
2026-03-28 06:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 477b42d0-3310-57c6-84df-6dd23e206805 with scrape type 2
2026-03-28 06:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 477b42d0-3310-57c6-84df-6dd23e206805, identifier: NM48533
2026-03-28 06:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 477b42d0-3310-57c6-84df-6dd23e206805 with identifier: NM48533
2026-03-28 06:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:31:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 06:31:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 477b42d0-3310-57c6-84df-6dd23e206805 with identifier: NM48533
2026-03-28 06:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 477b42d0-3310-57c6-84df-6dd23e206805 with identifier: NM48533 to the API
2026-03-28 06:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:48:26Z',
 'fuel_type': 'diesel',
 'id': '477b42d0-3310-57c6-84df-6dd23e206805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM48533',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 99540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-04',
 'seller_name': None,
 'title': 'Hyundai i20 1.1 CRDi Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2014}
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM48533%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Saving data for NM48533: {'auction_closing_time': 1774716506.0, 'created_time': 1774557205.445069, 'last_price_update_time': 1774679502.157169}
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM48533') HTTP/1.1" 204 0
2026-03-28 06:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Scrape type for WL68728: 2
2026-03-28 06:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-28 06:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dcb4611-7b89-5852-bbde-a372106c0a9d with scrape type 2
2026-03-28 06:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dcb4611-7b89-5852-bbde-a372106c0a9d with scrape type 2
2026-03-28 06:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6dcb4611-7b89-5852-bbde-a372106c0a9d, identifier: WL68728
2026-03-28 06:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-28 06:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-28 06:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728 to the API
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:00:36Z',
 'fuel_type': 'petrol',
 'id': '6dcb4611-7b89-5852-bbde-a372106c0a9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL68728',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 162154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-22',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2006}
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Saving data for WL68728: {'auction_closing_time': 1774713636.0, 'created_time': 1774557188.44586, 'last_price_update_time': 1774679502.678645}
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL68728') HTTP/1.1" 204 0
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV71876%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Scrape type for WV71876: 0
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX01610%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Scrape type for SX01610: 0
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT85674%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Scrape type for UT85674: 0
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR37378%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Scrape type for RR37378: 0
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-28 06:31:42 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ55081%27 HTTP/1.1" 200 None
2026-03-28 06:31:42 [auto1.be] INFO: Scrape type for MZ55081: 2
2026-03-28 06:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24527045-95e5-5175-a60e-d227c4d3c6c9 with identifier: MZ55081
2026-03-28 06:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24527045-95e5-5175-a60e-d227c4d3c6c9 with scrape type 2
2026-03-28 06:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24527045-95e5-5175-a60e-d227c4d3c6c9 with scrape type 2
2026-03-28 06:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24527045-95e5-5175-a60e-d227c4d3c6c9, identifier: MZ55081
2026-03-28 06:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24527045-95e5-5175-a60e-d227c4d3c6c9 with identifier: MZ55081
2026-03-28 06:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24527045-95e5-5175-a60e-d227c4d3c6c9 with identifier: MZ55081
2026-03-28 06:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24527045-95e5-5175-a60e-d227c4d3c6c9 with identifier: MZ55081 to the API
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:48Z',
 'fuel_type': 'diesel',
 'id': '24527045-95e5-5175-a60e-d227c4d3c6c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ55081',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 177818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-28',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Momentum 2WD',
 'transmission': 'manual',
 'trim': 'Momentum 2WD',
 'year': 2017}
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ55081%27 HTTP/1.1" 200 None
2026-03-28 06:31:43 [auto1.be] INFO: Saving data for MZ55081: {'auction_closing_time': 1774716888.0, 'created_time': 1773224695.474943, 'last_price_update_time': 1774679503.342697}
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ55081') HTTP/1.1" 204 0
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET32561%27 HTTP/1.1" 200 None
2026-03-28 06:31:43 [auto1.be] INFO: Scrape type for ET32561: 0
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-28 06:31:43 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-28 06:31:43 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-28 06:31:43 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-28 06:31:43 [auto1.be] INFO: Scrape type for CS46585: 2
2026-03-28 06:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-28 06:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9439004-4fc6-5383-9e68-aa6686a4b734 with scrape type 2
2026-03-28 06:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9439004-4fc6-5383-9e68-aa6686a4b734 with scrape type 2
2026-03-28 06:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9439004-4fc6-5383-9e68-aa6686a4b734, identifier: CS46585
2026-03-28 06:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-28 06:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-28 06:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585 to the API
2026-03-28 06:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:10:12Z',
 'fuel_type': 'petrol',
 'id': 'c9439004-4fc6-5383-9e68-aa6686a4b734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS46585',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 209791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-28 06:31:44 [auto1.be] INFO: Saving data for CS46585: {'auction_closing_time': 1774714212.0, 'created_time': 1774557140.909173, 'last_price_update_time': 1774679504.862811}
2026-03-28 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS46585') HTTP/1.1" 204 0
2026-03-28 06:31:44 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-28 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-28 06:31:44 [auto1.be] INFO: Scrape type for TS12124: 2
2026-03-28 06:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with identifier: TS12124
2026-03-28 06:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with scrape type 2
2026-03-28 06:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with scrape type 2
2026-03-28 06:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04, identifier: TS12124
2026-03-28 06:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with identifier: TS12124
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 06:31:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 06:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with identifier: TS12124
2026-03-28 06:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b3df74f-76c7-5027-9fd8-5f6326bc6e04 with identifier: TS12124 to the API
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:52:56Z',
 'fuel_type': 'diesel',
 'id': '9b3df74f-76c7-5027-9fd8-5f6326bc6e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS12124',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 207156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-27',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 e-HDi XTR',
 'transmission': 'automatic',
 'trim': 'XTR',
 'year': 2014}
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-28 06:31:45 [auto1.be] INFO: Saving data for TS12124: {'auction_closing_time': 1774716776.0, 'created_time': 1773131744.964197, 'last_price_update_time': 1774679505.454313}
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS12124') HTTP/1.1" 204 0
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM71971%27 HTTP/1.1" 200 None
2026-03-28 06:31:45 [auto1.be] INFO: Scrape type for CM71971: 0
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-28 06:31:45 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-28 06:31:45 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY13057%27 HTTP/1.1" 200 None
2026-03-28 06:31:45 [auto1.be] INFO: Scrape type for VY13057: 2
2026-03-28 06:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5adcb7-f4c3-5cf8-867c-f83d81819d97 with identifier: VY13057
2026-03-28 06:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5adcb7-f4c3-5cf8-867c-f83d81819d97 with scrape type 2
2026-03-28 06:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5adcb7-f4c3-5cf8-867c-f83d81819d97 with scrape type 2
2026-03-28 06:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c5adcb7-f4c3-5cf8-867c-f83d81819d97, identifier: VY13057
2026-03-28 06:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c5adcb7-f4c3-5cf8-867c-f83d81819d97 with identifier: VY13057
2026-03-28 06:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c5adcb7-f4c3-5cf8-867c-f83d81819d97 with identifier: VY13057
2026-03-28 06:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c5adcb7-f4c3-5cf8-867c-f83d81819d97 with identifier: VY13057 to the API
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:14:47Z',
 'fuel_type': 'diesel',
 'id': '1c5adcb7-f4c3-5cf8-867c-f83d81819d97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY13057',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 232164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-06',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY13057%27 HTTP/1.1" 200 None
2026-03-28 06:31:45 [auto1.be] INFO: Saving data for VY13057: {'auction_closing_time': 1774714487.0, 'created_time': 1773136078.886516, 'last_price_update_time': 1774679505.956764}
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VY13057') HTTP/1.1" 204 0
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG30090%27 HTTP/1.1" 200 None
2026-03-28 06:31:45 [auto1.be] INFO: Scrape type for FG30090: 0
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-28 06:31:45 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-28 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-28 06:31:46 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-28 06:31:46 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD86825%27 HTTP/1.1" 200 None
2026-03-28 06:31:46 [auto1.be] INFO: Scrape type for PD86825: 2
2026-03-28 06:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fba6083-a430-5b49-ab30-faff1d5b2868 with identifier: PD86825
2026-03-28 06:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fba6083-a430-5b49-ab30-faff1d5b2868 with scrape type 2
2026-03-28 06:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fba6083-a430-5b49-ab30-faff1d5b2868 with scrape type 2
2026-03-28 06:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5fba6083-a430-5b49-ab30-faff1d5b2868, identifier: PD86825
2026-03-28 06:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5fba6083-a430-5b49-ab30-faff1d5b2868 with identifier: PD86825
2026-03-28 06:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5fba6083-a430-5b49-ab30-faff1d5b2868 with identifier: PD86825
2026-03-28 06:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5fba6083-a430-5b49-ab30-faff1d5b2868 with identifier: PD86825 to the API
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:31:07Z',
 'fuel_type': 'hybrid',
 'id': '5fba6083-a430-5b49-ab30-faff1d5b2868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD86825',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 213772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD86825%27 HTTP/1.1" 200 None
2026-03-28 06:31:46 [auto1.be] INFO: Saving data for PD86825: {'auction_closing_time': 1774715467.0, 'created_time': 1773224002.283071, 'last_price_update_time': 1774679506.4015}
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD86825') HTTP/1.1" 204 0
2026-03-28 06:31:46 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS17719%27 HTTP/1.1" 200 None
2026-03-28 06:31:46 [auto1.be] INFO: Scrape type for WS17719: 0
2026-03-28 06:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:51 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ84457%27 HTTP/1.1" 200 None
2026-03-28 06:31:51 [auto1.be] INFO: Scrape type for MJ84457: 0
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT43988%27 HTTP/1.1" 200 None
2026-03-28 06:31:51 [auto1.be] INFO: Scrape type for LT43988: 0
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV95180%27 HTTP/1.1" 200 None
2026-03-28 06:31:51 [auto1.be] INFO: Scrape type for GV95180: 0
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-28 06:31:51 [auto1.be] INFO: Scrape type for DY90857: 0
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF21618%27 HTTP/1.1" 200 None
2026-03-28 06:31:51 [auto1.be] INFO: Scrape type for BF21618: 2
2026-03-28 06:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4963bf96-70d0-515c-b8f3-a2b6ec93129d with identifier: BF21618
2026-03-28 06:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4963bf96-70d0-515c-b8f3-a2b6ec93129d with scrape type 2
2026-03-28 06:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4963bf96-70d0-515c-b8f3-a2b6ec93129d with scrape type 2
2026-03-28 06:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4963bf96-70d0-515c-b8f3-a2b6ec93129d, identifier: BF21618
2026-03-28 06:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4963bf96-70d0-515c-b8f3-a2b6ec93129d with identifier: BF21618
2026-03-28 06:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4963bf96-70d0-515c-b8f3-a2b6ec93129d with identifier: BF21618
2026-03-28 06:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4963bf96-70d0-515c-b8f3-a2b6ec93129d with identifier: BF21618 to the API
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:51:31Z',
 'fuel_type': 'petrol',
 'id': '4963bf96-70d0-515c-b8f3-a2b6ec93129d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF21618',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 140279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-18',
 'seller_name': None,
 'title': 'Porsche Cayenne 3.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF21618%27 HTTP/1.1" 200 None
2026-03-28 06:31:51 [auto1.be] INFO: Saving data for BF21618: {'auction_closing_time': 1774716691.0, 'created_time': 1773133469.391377, 'last_price_update_time': 1774679511.73367}
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BF21618') HTTP/1.1" 204 0
2026-03-28 06:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-28 06:31:51 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-28 06:31:51 [auto1.be] INFO: Scrape type for ZC05502: 2
2026-03-28 06:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with identifier: ZC05502
2026-03-28 06:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with scrape type 2
2026-03-28 06:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with scrape type 2
2026-03-28 06:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46b2ee45-83e8-5f11-adfe-4b023a613aa7, identifier: ZC05502
2026-03-28 06:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with identifier: ZC05502
2026-03-28 06:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with identifier: ZC05502
2026-03-28 06:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46b2ee45-83e8-5f11-adfe-4b023a613aa7 with identifier: ZC05502 to the API
2026-03-28 06:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:11:44Z',
 'fuel_type': 'petrol',
 'id': '46b2ee45-83e8-5f11-adfe-4b023a613aa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC05502',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 88074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Saving data for ZC05502: {'auction_closing_time': 1774714304.0, 'created_time': 1773136848.541543, 'last_price_update_time': 1774679512.162005}
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC05502') HTTP/1.1" 204 0
2026-03-28 06:31:52 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Scrape type for EL40372: 0
2026-03-28 06:31:52 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA79982%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Scrape type for NA79982: 0
2026-03-28 06:31:52 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA12532%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Scrape type for CA12532: 0
2026-03-28 06:31:52 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-28 06:31:52 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-28 06:31:52 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-28 06:31:52 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Scrape type for SE23508: 2
2026-03-28 06:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-28 06:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c69bc39-c11c-5919-8d30-91351a0d8613 with scrape type 2
2026-03-28 06:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c69bc39-c11c-5919-8d30-91351a0d8613 with scrape type 2
2026-03-28 06:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c69bc39-c11c-5919-8d30-91351a0d8613, identifier: SE23508
2026-03-28 06:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-28 06:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-28 06:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508 to the API
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:57:02Z',
 'fuel_type': 'petrol',
 'id': '4c69bc39-c11c-5919-8d30-91351a0d8613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE23508',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 198922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2012}
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Saving data for SE23508: {'auction_closing_time': 1774717022.0, 'created_time': 1774557228.459315, 'last_price_update_time': 1774679512.774885}
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE23508') HTTP/1.1" 204 0
2026-03-28 06:31:52 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-28 06:31:52 [auto1.be] INFO: Scrape type for YS56392: 2
2026-03-28 06:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-28 06:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edcc5390-50a7-54b2-ad24-fd722dbd2608 with scrape type 2
2026-03-28 06:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edcc5390-50a7-54b2-ad24-fd722dbd2608 with scrape type 2
2026-03-28 06:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: edcc5390-50a7-54b2-ad24-fd722dbd2608, identifier: YS56392
2026-03-28 06:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-28 06:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-28 06:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392 to the API
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:07:04Z',
 'fuel_type': 'diesel',
 'id': 'edcc5390-50a7-54b2-ad24-fd722dbd2608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS56392',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 392142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Saving data for YS56392: {'auction_closing_time': 1774714024.0, 'created_time': 1774557198.346742, 'last_price_update_time': 1774679513.229951}
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS56392') HTTP/1.1" 204 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG71639%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for MG71639: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC37877%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for XC37877: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP60973%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for KP60973: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK66135%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for NK66135: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY55711%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for JY55711: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP40379%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for NP40379: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX78624%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for RX78624: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-28 06:31:53 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-28 06:31:53 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-28 06:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:54 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Scrape type for MN41841: 2
2026-03-28 06:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-28 06:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f978f149-e638-548e-8826-f7636922c944 with scrape type 2
2026-03-28 06:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f978f149-e638-548e-8826-f7636922c944 with scrape type 2
2026-03-28 06:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f978f149-e638-548e-8826-f7636922c944, identifier: MN41841
2026-03-28 06:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-28 06:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-28 06:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841 to the API
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:27:43Z',
 'fuel_type': 'petrol',
 'id': 'f978f149-e638-548e-8826-f7636922c944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN41841',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 51950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-24',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2020}
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Saving data for MN41841: {'auction_closing_time': 1774715263.0, 'created_time': 1774557197.321646, 'last_price_update_time': 1774679514.675108}
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MN41841') HTTP/1.1" 204 0
2026-03-28 06:31:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Scrape type for DH79590: 0
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: SD12606
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD12606%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Scrape type for SD12606: 0
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ68355%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Scrape type for NZ68355: 0
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM34677%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Scrape type for EM34677: 0
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: VW93174
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-28 06:31:54 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW05863%27 HTTP/1.1" 200 None
2026-03-28 06:31:54 [auto1.be] INFO: Scrape type for SW05863: 2
2026-03-28 06:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fa81381-2270-5ad7-8bb2-0eb0d73a5f95 with identifier: SW05863
2026-03-28 06:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fa81381-2270-5ad7-8bb2-0eb0d73a5f95 with scrape type 2
2026-03-28 06:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fa81381-2270-5ad7-8bb2-0eb0d73a5f95 with scrape type 2
2026-03-28 06:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3fa81381-2270-5ad7-8bb2-0eb0d73a5f95, identifier: SW05863
2026-03-28 06:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3fa81381-2270-5ad7-8bb2-0eb0d73a5f95 with identifier: SW05863
2026-03-28 06:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3fa81381-2270-5ad7-8bb2-0eb0d73a5f95 with identifier: SW05863
2026-03-28 06:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3fa81381-2270-5ad7-8bb2-0eb0d73a5f95 with identifier: SW05863 to the API
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:13:18Z',
 'fuel_type': 'petrol',
 'id': '3fa81381-2270-5ad7-8bb2-0eb0d73a5f95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW05863',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 90359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2019}
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW05863%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Saving data for SW05863: {'auction_closing_time': 1774714398.0, 'created_time': 1774471379.774075, 'last_price_update_time': 1774679515.32172}
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW05863') HTTP/1.1" 204 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW28397%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for EW28397: 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ35254%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for CZ35254: 2
2026-03-28 06:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf889a33-4f5c-5a41-b2af-25bc8896be5e with identifier: CZ35254
2026-03-28 06:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf889a33-4f5c-5a41-b2af-25bc8896be5e with scrape type 2
2026-03-28 06:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf889a33-4f5c-5a41-b2af-25bc8896be5e with scrape type 2
2026-03-28 06:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf889a33-4f5c-5a41-b2af-25bc8896be5e, identifier: CZ35254
2026-03-28 06:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf889a33-4f5c-5a41-b2af-25bc8896be5e with identifier: CZ35254
2026-03-28 06:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf889a33-4f5c-5a41-b2af-25bc8896be5e with identifier: CZ35254
2026-03-28 06:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf889a33-4f5c-5a41-b2af-25bc8896be5e with identifier: CZ35254 to the API
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:58:33Z',
 'fuel_type': 'diesel',
 'id': 'bf889a33-4f5c-5a41-b2af-25bc8896be5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ35254',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 72768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet Basis Maxi Kasten',
 'transmission': 'manual',
 'trim': 'Basis Maxi Kasten',
 'year': 2017}
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ35254%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Saving data for CZ35254: {'auction_closing_time': 1774717113.0, 'created_time': 1773136762.100344, 'last_price_update_time': 1774679515.861188}
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CZ35254') HTTP/1.1" 204 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for XU40393: 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK36221%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for DK36221: 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16246%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for RS16246: 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for CW36552: 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: CB02189
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: FJ85398
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN96756%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for EN96756: 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG16696%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for RG16696: 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: PC39555
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD01860%27 HTTP/1.1" 200 None
2026-03-28 06:31:55 [auto1.be] INFO: Scrape type for FD01860: 0
2026-03-28 06:31:55 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-28 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-28 06:31:56 [auto1.be] INFO: Scrape type for PE06051: 0
2026-03-28 06:31:56 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-28 06:31:56 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-28 06:31:56 [auto1.be] INFO: Found listing with ID: XN84271
2026-03-28 06:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:31:57 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1663 | hits on page: 40
2026-03-28 06:31:57 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-28 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-28 06:31:57 [auto1.be] INFO: Scrape type for PH78267: 0
2026-03-28 06:31:57 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 06:31:57 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-28 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS23980%27 HTTP/1.1" 200 None
2026-03-28 06:31:57 [auto1.be] INFO: Scrape type for YS23980: 0
2026-03-28 06:31:57 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-28 06:31:57 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-28 06:31:57 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-28 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-28 06:31:57 [auto1.be] INFO: Scrape type for SU19738: 2
2026-03-28 06:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7508af-0178-5878-8417-86a88c1c1c2d with identifier: SU19738
2026-03-28 06:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7508af-0178-5878-8417-86a88c1c1c2d with scrape type 2
2026-03-28 06:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c7508af-0178-5878-8417-86a88c1c1c2d with scrape type 2
2026-03-28 06:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c7508af-0178-5878-8417-86a88c1c1c2d, identifier: SU19738
2026-03-28 06:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c7508af-0178-5878-8417-86a88c1c1c2d with identifier: SU19738
2026-03-28 06:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c7508af-0178-5878-8417-86a88c1c1c2d with identifier: SU19738
2026-03-28 06:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c7508af-0178-5878-8417-86a88c1c1c2d with identifier: SU19738 to the API
2026-03-28 06:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:12:06Z',
 'fuel_type': 'petrol',
 'id': '7c7508af-0178-5878-8417-86a88c1c1c2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU19738',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 47225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Saving data for SU19738: {'auction_closing_time': 1774714326.0, 'created_time': 1773133297.294197, 'last_price_update_time': 1774679518.084918}
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SU19738') HTTP/1.1" 204 0
2026-03-28 06:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: XN65088
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN65088%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for XN65088: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: YH93162
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: FB63888
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: MB61651
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB61651%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for MB61651: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL90308%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for JL90308: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for ZC87174: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX95713%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for GX95713: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: HE27589
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: TC02969
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF50688%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for PF50688: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for UF75491: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: KW79847
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW79847%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for KW79847: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for UL34611: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for SD60477: 2
2026-03-28 06:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-28 06:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28c308f-15ef-532a-9282-4ec5834d659a with scrape type 2
2026-03-28 06:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c28c308f-15ef-532a-9282-4ec5834d659a with scrape type 2
2026-03-28 06:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c28c308f-15ef-532a-9282-4ec5834d659a, identifier: SD60477
2026-03-28 06:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-28 06:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-28 06:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477 to the API
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:44:17Z',
 'fuel_type': 'petrol',
 'id': 'c28c308f-15ef-532a-9282-4ec5834d659a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD60477',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 194585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 Si4 TwinTurbo HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2021}
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Saving data for SD60477: {'auction_closing_time': 1774716257.0, 'created_time': 1774557246.682763, 'last_price_update_time': 1774679518.792147}
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD60477') HTTP/1.1" 204 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM94010%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for SM94010: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: PS48856
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS48856%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for PS48856: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: MS47880
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS47880%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for MS47880: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH74784%27 HTTP/1.1" 200 None
2026-03-28 06:31:58 [auto1.be] INFO: Scrape type for LH74784: 0
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-28 06:31:58 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-28 06:31:59 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-28 06:31:59 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF55706%27 HTTP/1.1" 200 None
2026-03-28 06:31:59 [auto1.be] INFO: Scrape type for NF55706: 0
2026-03-28 06:31:59 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-28 06:31:59 [auto1.be] INFO: Scrape type for PD78607: 2
2026-03-28 06:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with identifier: PD78607
2026-03-28 06:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with scrape type 2
2026-03-28 06:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with scrape type 2
2026-03-28 06:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842, identifier: PD78607
2026-03-28 06:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with identifier: PD78607
2026-03-28 06:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with identifier: PD78607
2026-03-28 06:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4659c5f0-4955-5fd5-bfa2-1fd49ccff842 with identifier: PD78607 to the API
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:40:34Z',
 'fuel_type': 'petrol',
 'id': '4659c5f0-4955-5fd5-bfa2-1fd49ccff842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD78607',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 155229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-21',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2010}
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-28 06:31:59 [auto1.be] INFO: Saving data for PD78607: {'auction_closing_time': 1774716034.0, 'created_time': 1773136307.054497, 'last_price_update_time': 1774679519.459017}
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD78607') HTTP/1.1" 204 0
2026-03-28 06:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:00 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:00 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-28 06:32:00 [auto1.be] INFO: Scrape type for ZX58483: 2
2026-03-28 06:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54e30372-8309-572c-be0e-4092fd077682 with identifier: ZX58483
2026-03-28 06:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54e30372-8309-572c-be0e-4092fd077682 with scrape type 2
2026-03-28 06:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54e30372-8309-572c-be0e-4092fd077682 with scrape type 2
2026-03-28 06:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54e30372-8309-572c-be0e-4092fd077682, identifier: ZX58483
2026-03-28 06:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54e30372-8309-572c-be0e-4092fd077682 with identifier: ZX58483
2026-03-28 06:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54e30372-8309-572c-be0e-4092fd077682 with identifier: ZX58483
2026-03-28 06:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54e30372-8309-572c-be0e-4092fd077682 with identifier: ZX58483 to the API
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:17:11Z',
 'fuel_type': 'petrol',
 'id': '54e30372-8309-572c-be0e-4092fd077682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX58483',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 113905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-11',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2013}
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-28 06:32:00 [auto1.be] INFO: Saving data for ZX58483: {'auction_closing_time': 1774714631.0, 'created_time': 1773131705.623427, 'last_price_update_time': 1774679520.949495}
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX58483') HTTP/1.1" 204 0
2026-03-28 06:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:32:00 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-28 06:32:00 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX65351%27 HTTP/1.1" 200 None
2026-03-28 06:32:00 [auto1.be] INFO: Scrape type for GX65351: 0
2026-03-28 06:32:00 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-28 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for ZM46816: 2
2026-03-28 06:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-28 06:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893033fc-503b-505f-b9ed-049119557949 with scrape type 2
2026-03-28 06:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 893033fc-503b-505f-b9ed-049119557949 with scrape type 2
2026-03-28 06:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 893033fc-503b-505f-b9ed-049119557949, identifier: ZM46816
2026-03-28 06:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-28 06:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-28 06:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816 to the API
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:51:38Z',
 'fuel_type': 'diesel',
 'id': '893033fc-503b-505f-b9ed-049119557949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM46816',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 156922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI Sport edition',
 'transmission': 'manual',
 'trim': 'Sport edition',
 'year': 2017}
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Saving data for ZM46816: {'auction_closing_time': 1774716698.0, 'created_time': 1774557228.782041, 'last_price_update_time': 1774679521.394717}
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM46816') HTTP/1.1" 204 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: HS55716
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG32291%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for KG32291: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: UB82847
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: HR21590
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG39475%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for WG39475: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: NE31569
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS62440%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for KS62440: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL62340%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for CL62340: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: TF25932
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: BD17756
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: ND85214
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND85214%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for ND85214: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA67135%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for EA67135: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: BE11259
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE11259%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for BE11259: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: WP33906
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP33906%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for WP33906: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU67376%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for VU67376: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: YK21410
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for TZ53898: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-28 06:32:01 [auto1.be] INFO: Scrape type for WR41774: 0
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-28 06:32:01 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-28 06:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:02 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: RK77715
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK77715%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for RK77715: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for PS28625: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: CK03982
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: YC19133
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC19133%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for YC19133: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB27373%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for AB27373: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC51589%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for DC51589: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH28824%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for GH28824: 0
2026-03-28 06:32:02 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM41011%27 HTTP/1.1" 200 None
2026-03-28 06:32:02 [auto1.be] INFO: Scrape type for MM41011: 2
2026-03-28 06:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44f4cc9e-5be7-5652-8621-ff4eef70f2fb with identifier: MM41011
2026-03-28 06:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44f4cc9e-5be7-5652-8621-ff4eef70f2fb with scrape type 2
2026-03-28 06:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44f4cc9e-5be7-5652-8621-ff4eef70f2fb with scrape type 2
2026-03-28 06:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44f4cc9e-5be7-5652-8621-ff4eef70f2fb, identifier: MM41011
2026-03-28 06:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44f4cc9e-5be7-5652-8621-ff4eef70f2fb with identifier: MM41011
2026-03-28 06:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44f4cc9e-5be7-5652-8621-ff4eef70f2fb with identifier: MM41011
2026-03-28 06:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44f4cc9e-5be7-5652-8621-ff4eef70f2fb with identifier: MM41011 to the API
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 354,
 'expiration_date': '2026-03-28T16:13:43Z',
 'fuel_type': 'petrol',
 'id': '44f4cc9e-5be7-5652-8621-ff4eef70f2fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM41011',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 158041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-09',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM41011%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Saving data for MM41011: {'auction_closing_time': 1774714423.0, 'created_time': 1774557178.588136, 'last_price_update_time': 1774679523.331421}
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MM41011') HTTP/1.1" 204 0
2026-03-28 06:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for NM84060: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for SD20873: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB44505%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for NB44505: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ69289%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for ZJ69289: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ12403%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for HJ12403: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE83981%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for RE83981: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM39704%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for EM39704: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ65357%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for RJ65357: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for YL67549: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT89751%27 HTTP/1.1" 200 None
2026-03-28 06:32:03 [auto1.be] INFO: Scrape type for XT89751: 0
2026-03-28 06:32:03 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-28 06:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:04 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-28 06:32:04 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: LC40144
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC40144%27 HTTP/1.1" 200 None
2026-03-28 06:32:04 [auto1.be] INFO: Scrape type for LC40144: 0
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ47511%27 HTTP/1.1" 200 None
2026-03-28 06:32:04 [auto1.be] INFO: Scrape type for DZ47511: 0
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR67057%27 HTTP/1.1" 200 None
2026-03-28 06:32:04 [auto1.be] INFO: Scrape type for PR67057: 0
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: UL98118
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-28 06:32:04 [auto1.be] INFO: Scrape type for VL86303: 0
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-28 06:32:04 [auto1.be] INFO: Scrape type for DT02833: 0
2026-03-28 06:32:04 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG56126%27 HTTP/1.1" 200 None
2026-03-28 06:32:04 [auto1.be] INFO: Scrape type for MG56126: 2
2026-03-28 06:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9180f9f-f062-5015-b48e-70d52b4d630a with identifier: MG56126
2026-03-28 06:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9180f9f-f062-5015-b48e-70d52b4d630a with scrape type 2
2026-03-28 06:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9180f9f-f062-5015-b48e-70d52b4d630a with scrape type 2
2026-03-28 06:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9180f9f-f062-5015-b48e-70d52b4d630a, identifier: MG56126
2026-03-28 06:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9180f9f-f062-5015-b48e-70d52b4d630a with identifier: MG56126
2026-03-28 06:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9180f9f-f062-5015-b48e-70d52b4d630a with identifier: MG56126
2026-03-28 06:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9180f9f-f062-5015-b48e-70d52b4d630a with identifier: MG56126 to the API
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-28T16:03:43Z',
 'fuel_type': 'petrol',
 'id': 'f9180f9f-f062-5015-b48e-70d52b4d630a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG56126',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayman',
 'odometer': 50692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-20',
 'seller_name': None,
 'title': 'Porsche Cayman 2.7',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG56126%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Saving data for MG56126: {'auction_closing_time': 1774713823.0, 'created_time': 1773866600.325422, 'last_price_update_time': 1774679525.24671}
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG56126') HTTP/1.1" 204 0
2026-03-28 06:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: PA01247
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: FJ18494
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ18494%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Scrape type for FJ18494: 0
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Scrape type for LE69229: 2
2026-03-28 06:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-28 06:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155cb591-5e0a-54ad-b09e-9e57a683a273 with scrape type 2
2026-03-28 06:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 155cb591-5e0a-54ad-b09e-9e57a683a273 with scrape type 2
2026-03-28 06:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 155cb591-5e0a-54ad-b09e-9e57a683a273, identifier: LE69229
2026-03-28 06:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-28 06:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-28 06:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229 to the API
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:02:45Z',
 'fuel_type': 'diesel',
 'id': '155cb591-5e0a-54ad-b09e-9e57a683a273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE69229',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 155826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 CRDi App Mode',
 'transmission': 'manual',
 'trim': 'App Mode',
 'year': 2014}
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Saving data for LE69229: {'auction_closing_time': 1774713765.0, 'created_time': 1774557178.249835, 'last_price_update_time': 1774679525.769271}
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE69229') HTTP/1.1" 204 0
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: MC77569
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC77569%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Scrape type for MC77569: 0
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: PN32726
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR29123%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Scrape type for FR29123: 0
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX71438%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Scrape type for TX71438: 0
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: KY96002
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY96002%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Scrape type for KY96002: 0
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-28 06:32:05 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU65660%27 HTTP/1.1" 200 None
2026-03-28 06:32:05 [auto1.be] INFO: Scrape type for ZU65660: 2
2026-03-28 06:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b1e93f-d2c1-54dd-adb7-d40019532831 with identifier: ZU65660
2026-03-28 06:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b1e93f-d2c1-54dd-adb7-d40019532831 with scrape type 2
2026-03-28 06:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b1e93f-d2c1-54dd-adb7-d40019532831 with scrape type 2
2026-03-28 06:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0b1e93f-d2c1-54dd-adb7-d40019532831, identifier: ZU65660
2026-03-28 06:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0b1e93f-d2c1-54dd-adb7-d40019532831 with identifier: ZU65660
2026-03-28 06:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0b1e93f-d2c1-54dd-adb7-d40019532831 with identifier: ZU65660
2026-03-28 06:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0b1e93f-d2c1-54dd-adb7-d40019532831 with identifier: ZU65660 to the API
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:15Z',
 'fuel_type': 'diesel',
 'id': 'b0b1e93f-d2c1-54dd-adb7-d40019532831',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU65660',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 117104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-03',
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU65660%27 HTTP/1.1" 200 None
2026-03-28 06:32:06 [auto1.be] INFO: Saving data for ZU65660: {'auction_closing_time': 1774716315.0, 'created_time': 1774471052.74832, 'last_price_update_time': 1774679526.25298}
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU65660') HTTP/1.1" 204 0
2026-03-28 06:32:06 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY50069%27 HTTP/1.1" 200 None
2026-03-28 06:32:06 [auto1.be] INFO: Scrape type for TY50069: 2
2026-03-28 06:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c5f6334-4f26-580e-a4fd-9716e509a102 with identifier: TY50069
2026-03-28 06:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c5f6334-4f26-580e-a4fd-9716e509a102 with scrape type 2
2026-03-28 06:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c5f6334-4f26-580e-a4fd-9716e509a102 with scrape type 2
2026-03-28 06:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c5f6334-4f26-580e-a4fd-9716e509a102, identifier: TY50069
2026-03-28 06:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c5f6334-4f26-580e-a4fd-9716e509a102 with identifier: TY50069
2026-03-28 06:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c5f6334-4f26-580e-a4fd-9716e509a102 with identifier: TY50069
2026-03-28 06:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c5f6334-4f26-580e-a4fd-9716e509a102 with identifier: TY50069 to the API
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:35Z',
 'fuel_type': 'diesel',
 'id': '5c5f6334-4f26-580e-a4fd-9716e509a102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY50069',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 142728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super 2WD',
 'transmission': 'automatic',
 'trim': 'Super 2WD',
 'year': 2017}
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY50069%27 HTTP/1.1" 200 None
2026-03-28 06:32:06 [auto1.be] INFO: Saving data for TY50069: {'auction_closing_time': 1774715375.0, 'created_time': 1774471034.300329, 'last_price_update_time': 1774679526.737809}
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY50069') HTTP/1.1" 204 0
2026-03-28 06:32:06 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-28 06:32:06 [auto1.be] INFO: Found listing with ID: LH83403
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH83403%27 HTTP/1.1" 200 None
2026-03-28 06:32:06 [auto1.be] INFO: Scrape type for LH83403: 0
2026-03-28 06:32:06 [auto1.be] INFO: Found listing with ID: HP77494
2026-03-28 06:32:06 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV42280%27 HTTP/1.1" 200 None
2026-03-28 06:32:06 [auto1.be] INFO: Scrape type for WV42280: 0
2026-03-28 06:32:06 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-28 06:32:06 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-28 06:32:06 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-28 06:32:06 [scrapy.extensions.logstats] INFO: Crawled 30 pages (at 13 pages/min), scraped 119 items (at 53 items/min)
2026-03-28 06:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 06:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:48 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:48 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-28 06:32:48 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-28 06:32:48 [auto1.be] INFO: Scrape type for XH74025: 2
2026-03-28 06:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: effe9606-d1af-5b69-be8f-e5a4ba67b8ad with identifier: XH74025
2026-03-28 06:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item effe9606-d1af-5b69-be8f-e5a4ba67b8ad with scrape type 2
2026-03-28 06:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item effe9606-d1af-5b69-be8f-e5a4ba67b8ad with scrape type 2
2026-03-28 06:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: effe9606-d1af-5b69-be8f-e5a4ba67b8ad, identifier: XH74025
2026-03-28 06:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: effe9606-d1af-5b69-be8f-e5a4ba67b8ad with identifier: XH74025
2026-03-28 06:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: effe9606-d1af-5b69-be8f-e5a4ba67b8ad with identifier: XH74025
2026-03-28 06:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: effe9606-d1af-5b69-be8f-e5a4ba67b8ad with identifier: XH74025 to the API
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:54:02Z',
 'fuel_type': 'petrol',
 'id': 'effe9606-d1af-5b69-be8f-e5a4ba67b8ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH74025',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 78767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-23',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-28 06:32:48 [auto1.be] INFO: Saving data for XH74025: {'auction_closing_time': 1774716842.0, 'created_time': 1773134481.58507, 'last_price_update_time': 1774679568.699108}
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH74025') HTTP/1.1" 204 0
2026-03-28 06:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:32:48 [auto1.be] INFO: Found listing with ID: LM10661
2026-03-28 06:32:48 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-28 06:32:48 [auto1.be] INFO: Scrape type for DS23322: 2
2026-03-28 06:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-28 06:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32595404-1235-5729-b80a-df37f9f8a1ab with scrape type 2
2026-03-28 06:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32595404-1235-5729-b80a-df37f9f8a1ab with scrape type 2
2026-03-28 06:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 32595404-1235-5729-b80a-df37f9f8a1ab, identifier: DS23322
2026-03-28 06:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-28 06:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-28 06:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322 to the API
2026-03-28 06:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:37:41Z',
 'fuel_type': 'diesel',
 'id': '32595404-1235-5729-b80a-df37f9f8a1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS23322',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 99310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-28 06:32:49 [auto1.be] INFO: Saving data for DS23322: {'auction_closing_time': 1774715861.0, 'created_time': 1774557227.081863, 'last_price_update_time': 1774679569.121698}
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DS23322') HTTP/1.1" 204 0
2026-03-28 06:32:49 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA94606%27 HTTP/1.1" 200 None
2026-03-28 06:32:49 [auto1.be] INFO: Scrape type for GA94606: 0
2026-03-28 06:32:49 [auto1.be] INFO: Found listing with ID: WJ73148
2026-03-28 06:32:49 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD69238%27 HTTP/1.1" 200 None
2026-03-28 06:32:49 [auto1.be] INFO: Scrape type for UD69238: 2
2026-03-28 06:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9faa37e9-c6bb-5498-ba0f-79b739b9cfaa with identifier: UD69238
2026-03-28 06:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9faa37e9-c6bb-5498-ba0f-79b739b9cfaa with scrape type 2
2026-03-28 06:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9faa37e9-c6bb-5498-ba0f-79b739b9cfaa with scrape type 2
2026-03-28 06:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9faa37e9-c6bb-5498-ba0f-79b739b9cfaa, identifier: UD69238
2026-03-28 06:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9faa37e9-c6bb-5498-ba0f-79b739b9cfaa with identifier: UD69238
2026-03-28 06:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9faa37e9-c6bb-5498-ba0f-79b739b9cfaa with identifier: UD69238
2026-03-28 06:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9faa37e9-c6bb-5498-ba0f-79b739b9cfaa with identifier: UD69238 to the API
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:36:56Z',
 'fuel_type': 'diesel',
 'id': '9faa37e9-c6bb-5498-ba0f-79b739b9cfaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD69238',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 244930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-09',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D4 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2015}
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD69238%27 HTTP/1.1" 200 None
2026-03-28 06:32:49 [auto1.be] INFO: Saving data for UD69238: {'auction_closing_time': 1774715816.0, 'created_time': 1774471363.772782, 'last_price_update_time': 1774679569.665297}
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UD69238') HTTP/1.1" 204 0
2026-03-28 06:32:49 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-28 06:32:49 [auto1.be] INFO: Scrape type for UD97693: 2
2026-03-28 06:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-28 06:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a99e162-f27d-56e2-a8f3-81cb4f738387 with scrape type 2
2026-03-28 06:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a99e162-f27d-56e2-a8f3-81cb4f738387 with scrape type 2
2026-03-28 06:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a99e162-f27d-56e2-a8f3-81cb4f738387, identifier: UD97693
2026-03-28 06:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-28 06:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-28 06:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693 to the API
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:20:46Z',
 'fuel_type': 'petrol',
 'id': '9a99e162-f27d-56e2-a8f3-81cb4f738387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD97693',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 134582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2014}
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Saving data for UD97693: {'auction_closing_time': 1774714846.0, 'created_time': 1774557236.485623, 'last_price_update_time': 1774679570.089592}
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UD97693') HTTP/1.1" 204 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for YG22909: 2
2026-03-28 06:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-28 06:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade3345c-0246-5af7-9e45-7c293e54e453 with scrape type 2
2026-03-28 06:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade3345c-0246-5af7-9e45-7c293e54e453 with scrape type 2
2026-03-28 06:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ade3345c-0246-5af7-9e45-7c293e54e453, identifier: YG22909
2026-03-28 06:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-28 06:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-28 06:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909 to the API
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 06:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:48:12Z',
 'fuel_type': 'diesel',
 'id': 'ade3345c-0246-5af7-9e45-7c293e54e453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG22909',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 118099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2019}
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Saving data for YG22909: {'auction_closing_time': 1774716492.0, 'created_time': 1774557211.689161, 'last_price_update_time': 1774679570.519125}
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG22909') HTTP/1.1" 204 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: PE30752
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE30752%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for PE30752: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: LX91228
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX91228%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for LX91228: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: NN41814
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN41814%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for NN41814: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: UB59400
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: JW19159
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW19159%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for JW19159: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: XH16695
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH16695%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for XH16695: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: EY06710
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: RX67951
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: RB45450
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45450%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for RB45450: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: MP38676
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP38676%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for MP38676: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: VA35443
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA35443%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for VA35443: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for UB84592: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: ZM98751
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: AT11769
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT11769%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for AT11769: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: TA16395
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA16395%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for TA16395: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: YU29895
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: BD79780
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD79780%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for BD79780: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: WW25551
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW25551%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for WW25551: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: PC47788
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for PC06950: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: XJ17204
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for WT61211: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: YY54111
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY54111%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for YY54111: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: JX95723
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: JP70611
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: BY20411
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: UK22118
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK22118%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for UK22118: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: GM27988
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM27988%27 HTTP/1.1" 200 None
2026-03-28 06:32:50 [auto1.be] INFO: Scrape type for GM27988: 0
2026-03-28 06:32:50 [auto1.be] INFO: Found listing with ID: ED46000
2026-03-28 06:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:52 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: MU65745
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: RK66755
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK66755%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for RK66755: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: KU14362
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU14362%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for KU14362: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: CK52379
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK52379%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for CK52379: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: ED08551
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED08551%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for ED08551: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: UL77551
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL77551%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for UL77551: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: UV66357
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: PL62845
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL62845%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for PL62845: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: DD15930
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD15930%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for DD15930: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: CY27099
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY27099%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for CY27099: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: XU96332
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: GS41207
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: RJ05295
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ05295%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for RJ05295: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: SU53193
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: EG72902
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: YC45178
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for WJ68976: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: DM59351
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM59351%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for DM59351: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: ZU26363
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: ZJ61910
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: FP51010
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP51010%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for FP51010: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for CH15764: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: PH02429
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for PK93774: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: RK22486
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: YS95861
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS95861%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for YS95861: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: SP17871
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-28 06:32:52 [auto1.be] INFO: Scrape type for AM54260: 0
2026-03-28 06:32:52 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-28 06:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:53 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-28 06:32:53 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-28 06:32:53 [auto1.be] INFO: Scrape type for YB94076: 0
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-28 06:32:53 [auto1.be] INFO: Scrape type for PT26763: 0
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-28 06:32:53 [auto1.be] INFO: Scrape type for KW15988: 0
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-28 06:32:53 [auto1.be] INFO: Scrape type for MJ87524: 0
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: EY95319
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY95319%27 HTTP/1.1" 200 None
2026-03-28 06:32:53 [auto1.be] INFO: Scrape type for EY95319: 0
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-28 06:32:53 [auto1.be] INFO: Scrape type for YB47559: 0
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: HS77940
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS77940%27 HTTP/1.1" 200 None
2026-03-28 06:32:53 [auto1.be] INFO: Scrape type for HS77940: 0
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-28 06:32:53 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for CX99155: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for JC96921: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for LP39108: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: PK56681
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: NB55851
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB55851%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for NB55851: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: YV05904
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV05904%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for YV05904: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: ED29224
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED29224%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for ED29224: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: TT40798
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT40798%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for TT40798: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: BY03378
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY03378%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for BY03378: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: DL69403
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL69403%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for DL69403: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: BW39031
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: ZC14202
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC14202%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for ZC14202: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: AB96361
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB96361%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for AB96361: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: BF15536
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: PC04988
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: YG09924
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG09924%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for YG09924: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: TG48894
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG48894%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for TG48894: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: HY14348
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: MJ44397
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ44397%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for MJ44397: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: EA81543
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA81543%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for EA81543: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for XT36171: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: UU52750
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: RA83369
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA83369%27 HTTP/1.1" 200 None
2026-03-28 06:32:54 [auto1.be] INFO: Scrape type for RA83369: 0
2026-03-28 06:32:54 [auto1.be] INFO: Found listing with ID: GE95300
2026-03-28 06:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:55 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for DB21184: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: XN79579
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: WF25377
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF25377%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for WF25377: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: UB54556
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB54556%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for UB54556: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: UP37204
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UP37204%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for UP37204: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for YF30387: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: TP34819
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: MV25434
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: EZ95206
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ95206%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for EZ95206: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: XZ13946
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: JC83971
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: AG12322
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG12322%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for AG12322: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: VJ63338
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for SE12861: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for AW74184: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: KT11413
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: WN35442
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN35442%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for WN35442: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: HY09771
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: LB74355
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB74355%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for LB74355: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: FY16186
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY16186%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for FY16186: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: YD33796
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD33796%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for YD33796: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: MA85452
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA85452%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for MA85452: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for LE91648: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for FH50113: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: UJ35064
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ35064%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for UJ35064: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: FJ75207
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: EL87249
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for TV22564: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: UD25678
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD25678%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for UD25678: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for ME81448: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for XN92471: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-28 06:32:55 [auto1.be] INFO: Scrape type for HH24769: 0
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: VS70966
2026-03-28 06:32:55 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-28 06:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:57 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: LR03762
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for RG44645: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: VK87411
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK87411%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for VK87411: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for ZT52703: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for RK68346: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: HH43502
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for ZL81412: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: CE21828
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: JR17508
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: RK20492
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK20492%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for RK20492: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for RM51088: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: LF48909
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF48909%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for LF48909: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for FS62191: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: MS34473
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: MF52944
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF52944%27 HTTP/1.1" 200 None
2026-03-28 06:32:57 [auto1.be] INFO: Scrape type for MF52944: 0
2026-03-28 06:32:57 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-28 06:32:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:32:58 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1663 | hits on page: 40
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for NY99560: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for LJ91533: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for AF71611: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for UU12218: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: KZ70715
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ70715%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for KZ70715: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: WW24606
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for WU43595: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: VF96553
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: TR55859
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for EX56301: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: SL68944
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for LE66186: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for LA76788: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: XL87749
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL87749%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for XL87749: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: VV55176
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV55176%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for VV55176: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: CY69823
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY69823%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for CY69823: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: BV68544
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV68544%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for BV68544: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: CP59959
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for MV82025: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: ZU40891
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: PM95515
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for CS20047: 0
2026-03-28 06:32:58 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-28 06:32:58 [auto1.be] INFO: Scrape type for HS49836: 0
2026-03-28 06:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:06 [scrapy.extensions.logstats] INFO: Crawled 36 pages (at 6 pages/min), scraped 124 items (at 5 items/min)
2026-03-28 06:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 06:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:10 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-28 06:33:10 [auto1.be] INFO: Scrape type for DY69036: 0
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-28 06:33:10 [auto1.be] INFO: Scrape type for DB02418: 0
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: MA13965
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-28 06:33:10 [auto1.be] INFO: Scrape type for RB98158: 0
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: XL31605
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-28 06:33:10 [auto1.be] INFO: Scrape type for KC19835: 0
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-28 06:33:10 [auto1.be] INFO: Scrape type for MZ83142: 0
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-28 06:33:10 [auto1.be] INFO: Scrape type for WD81319: 0
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: MC08958
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC08958%27 HTTP/1.1" 200 None
2026-03-28 06:33:10 [auto1.be] INFO: Scrape type for MC08958: 0
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-28 06:33:10 [auto1.be] INFO: Scrape type for NU46591: 0
2026-03-28 06:33:10 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for LZ48262: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for TY52799: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for RA46458: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for ET79377: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for CK14854: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: AM57328
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for KF59500: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for DW87206: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: FV08195
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for ZR52684: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: KT14369
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT14369%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for KT14369: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: BE30662
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30662%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for BE30662: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB28782%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for DB28782: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: SP13149
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP13149%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for SP13149: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-28 06:33:11 [auto1.be] INFO: Scrape type for SV23823: 0
2026-03-28 06:33:11 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-28 06:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:12 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: ST31185
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for HT96077: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: WT92928
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for CR22525: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for BC69430: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: VT14549
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: WG79733
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: BB02902
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB02902%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for BB02902: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for AX12673: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for HY58683: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for CG91643: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for HT09098: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: GB76910
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: WF72066
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for PB25162: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: RR14818
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for SD15124: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for YJ00240: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL56745%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for YL56745: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW68449%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for ZW68449: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME80219%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for ME80219: 0
2026-03-28 06:33:12 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-28 06:33:12 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-28 06:33:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:14 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB11071%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for DB11071: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for BD22160: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB74591%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for KB74591: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-28 06:33:14 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-28 06:33:14 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-28 06:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-28 06:33:15 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-28 06:33:15 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-28 06:33:15 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-28 06:33:15 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-28 06:33:15 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-28 06:33:15 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-28 06:33:15 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-28 06:33:15 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-28 06:33:15 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-28 06:33:15 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-28 06:33:15 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-28 06:33:15 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-28 06:33:15 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-28 06:33:15 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-28 06:33:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:16 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET95220%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for ET95220: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL38834%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for YL38834: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY90554%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for UY90554: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-28 06:33:16 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-28 06:33:16 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-28 06:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-28 06:33:17 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-28 06:33:17 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 06:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-28 06:33:17 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-28 06:33:17 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-28 06:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-28 06:33:17 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-28 06:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:18 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH99432%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for JH99432: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY40839%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for PY40839: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX31629%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for JX31629: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-28 06:33:18 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-28 06:33:18 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-28 06:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-28 06:33:19 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-28 06:33:19 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-28 06:33:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:20 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-28 06:33:20 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU75052%27 HTTP/1.1" 200 None
2026-03-28 06:33:20 [auto1.be] INFO: Scrape type for YU75052: 0
2026-03-28 06:33:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:21 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-28 06:33:21 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-28 06:33:21 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-28 06:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:23 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-28 06:33:23 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-28 06:33:23 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-28 06:33:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:24 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1663 | hits on page: 40
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV01116%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for VV01116: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC70774%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for WC70774: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL41837%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for RL41837: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB52098%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for DB52098: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84983%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for NM84983: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD45447%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for TD45447: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB97201%27 HTTP/1.1" 200 None
2026-03-28 06:33:24 [auto1.be] INFO: Scrape type for MB97201: 0
2026-03-28 06:33:24 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-28 06:33:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:25 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1663 | hits on page: 23
2026-03-28 06:33:25 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-28 06:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-28 06:33:25 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-28 06:33:25 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 06:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-28 06:33:25 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-28 06:33:25 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-28 06:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN38450%27 HTTP/1.1" 200 None
2026-03-28 06:33:25 [auto1.be] INFO: Scrape type for GN38450: 0
2026-03-28 06:33:25 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-28 06:33:25 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-28 06:33:25 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-28 06:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL26855%27 HTTP/1.1" 200 None
2026-03-28 06:33:25 [auto1.be] INFO: Scrape type for PL26855: 0
2026-03-28 06:33:25 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-28 06:33:26 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP74088%27 HTTP/1.1" 200 None
2026-03-28 06:33:26 [auto1.be] INFO: Scrape type for BP74088: 0
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-28 06:33:26 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-28 06:33:26 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-28 06:33:26 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-28 06:33:26 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-28 06:33:26 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-28 06:33:26 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE06286%27 HTTP/1.1" 200 None
2026-03-28 06:33:26 [auto1.be] INFO: Scrape type for JE06286: 0
2026-03-28 06:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 06:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 06:33:26 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1663 | hits on page: 0
2026-03-28 06:33:26 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 06:33:26 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-28 06:33:26 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 315, <ScrapeType.BATCH_SKIPPED: 5>: 301}
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774247607 HTTP/1.1" 200 None
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AB04209') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AC71580') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AD76625') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AE92878') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AG68489') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AM30730') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AU38169') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AZ39903') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BB63975') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BC33060') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BC33385') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ41622') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BL31735') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BM82371') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BR93088') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BU07832') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BW95628') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BY20726') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BY32754') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BY53909') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CA80795') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CC34063') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CE09114') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CL05205') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CM92821') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DA58595') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DD63013') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DF78239') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DN00999') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EF27607') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EF47293') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ00268') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EM05281') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EM72587') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EP00364') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EU75132') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EY82206') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FF12443') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FT23017') HTTP/1.1" 204 0
2026-03-28 06:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FT53087') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FU54714') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FV32890') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FV57701') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GS91815') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GT10948') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GV63783') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GW33934') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HA12513') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HL05662') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HL21811') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HN01390') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HW96434') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JE05784') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JK97042') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JU82861') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JV43445') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JY54428') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KP03687') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KP55338') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KP90039') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KP95078') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KU68109') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LK52725') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LY17098') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ME40159') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MH83966') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MS99747') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MW39100') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NH00246') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NL33416') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NL39837') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NP55006') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NV19298') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NW45370') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ33071') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ61095') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PA70408') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PF75414') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PG04506') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PG48700') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ82421') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PU68159') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RD04523') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RK43455') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RN83351') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RV87365') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SA21509') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SC82113') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SE06895') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SF64520') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SW43031') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TH28748') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TL00014') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TR13838') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UK31480') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UN98541') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UT63156') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UU62258') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UX88947') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ44253') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VE88980') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VK24312') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VN32517') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VP06293') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VP17358') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WK08476') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WP36983') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WP77155') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XG31280') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XH31830') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XK55936') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XS76018') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XU68917') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YD71561') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YM37301') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YZ86935') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL05202') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL98041') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS74461') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT54034') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZV58319') HTTP/1.1" 204 0
2026-03-28 06:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZV90366') HTTP/1.1" 204 0
2026-03-28 06:33:28 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (124 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-28T06_30_00.jl
2026-03-28 06:33:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 131791,
 'downloader/request_count': 47,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 45,
 'downloader/response_bytes': 7887428,
 'downloader/response_count': 47,
 'downloader/response_status_count/200': 47,
 'elapsed_time_seconds': 202.074047,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 6, 33, 28, 829449, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 124,
 'log_count/DEBUG': 2903,
 'log_count/INFO': 3684,
 'memusage/max': 162721792,
 'memusage/startup': 147673088,
 'request_depth_max': 46,
 'response_received_count': 47,
 'scheduler/dequeued': 47,
 'scheduler/dequeued/memory': 47,
 'scheduler/enqueued': 47,
 'scheduler/enqueued/memory': 47,
 'scrape_type/batch_skipped': 821,
 'scrape_type/price_update': 124,
 'scrape_type/skipped': 758,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 47,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.388481893715389,
 'scrapy-zyte-api/mean_response_seconds': 3.5271151838229677,
 'scrapy-zyte-api/processed': 47,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 47,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 46,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 47,
 'scrapy-zyte-api/request_args/httpRequestBody': 45,
 'scrapy-zyte-api/request_args/httpRequestMethod': 45,
 'scrapy-zyte-api/request_args/httpResponseBody': 47,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 47,
 'scrapy-zyte-api/request_args/sessionContext': 47,
 'scrapy-zyte-api/request_args/url': 47,
 'scrapy-zyte-api/status_codes/200': 47,
 'scrapy-zyte-api/success': 47,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1703,
 'source/total_available': 1663,
 'start_time': datetime.datetime(2026, 3, 28, 6, 30, 6, 755402, tzinfo=datetime.timezone.utc)}
2026-03-28 06:33:28 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 06:33:29 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb8fb152250>
2026-03-28 06:33:29 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb8fb2a0190>