2026-03-28 07:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 07:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 07:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-28 07:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-28 07:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 07:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 07:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 07:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 07:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: d19ccd1737127e29
2026-03-28 07:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-28 07:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-28T07_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-28 07:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 07:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 07:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 07:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 07:00:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 07:00:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 07:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 07:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 07:00:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 07:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 07:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 07:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 07:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 07:00:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 07:00:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 07:00:07 [scrapy.core.engine] INFO: Spider opened
2026-03-28 07:00:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 07:00:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 07:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-28 07:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-28 07:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-28 07:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 07:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 07:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 07:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 07:00:17 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW85568%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for XW85568: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR13994%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for AR13994: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA41421%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for CA41421: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for EX94963: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA54727%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for ZA54727: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX02996%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for BX02996: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for RY27630: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for FE12544: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG41463%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for CG41463: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV36091%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for FV36091: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SJ21377%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for SJ21377: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG42232%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for DG42232: 0
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 07:00:17 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-28 07:00:17 [auto1.nl] INFO: Scrape type for NJ80961: 2
2026-03-28 07:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810f1df7-8502-532e-a304-7c105274fc86 with identifier: NJ80961
2026-03-28 07:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810f1df7-8502-532e-a304-7c105274fc86 with scrape type 2
2026-03-28 07:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810f1df7-8502-532e-a304-7c105274fc86 with scrape type 2
2026-03-28 07:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 810f1df7-8502-532e-a304-7c105274fc86, identifier: NJ80961
2026-03-28 07:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 810f1df7-8502-532e-a304-7c105274fc86 with identifier: NJ80961
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 07:00:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 07:00:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 810f1df7-8502-532e-a304-7c105274fc86 with identifier: NJ80961
2026-03-28 07:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 810f1df7-8502-532e-a304-7c105274fc86 with identifier: NJ80961 to the API
2026-03-28 07:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:12:10Z',
'fuel_type': 'petrol',
'id': '810f1df7-8502-532e-a304-7c105274fc86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ80961',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 189796,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-11',
'seller_name': None,
'title': 'Opel Astra 1.0 Turbo Edition Start/Stop',
'transmission': 'manual',
'trim': 'Edition Start/Stop',
'year': 2016}
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-28 07:00:19 [auto1.nl] INFO: Saving data for NJ80961: {'auction_closing_time': 1774714330.0, 'created_time': 1773837174.231986, 'last_price_update_time': 1774681219.768323}
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ80961') HTTP/1.1" 204 0
2026-03-28 07:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:19 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-28 07:00:19 [auto1.nl] INFO: Scrape type for PL67988: 0
2026-03-28 07:00:19 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU22503%27 HTTP/1.1" 200 None
2026-03-28 07:00:19 [auto1.nl] INFO: Scrape type for EU22503: 0
2026-03-28 07:00:19 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS76145%27 HTTP/1.1" 200 None
2026-03-28 07:00:19 [auto1.nl] INFO: Scrape type for CS76145: 0
2026-03-28 07:00:19 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 07:00:19 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 07:00:19 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA85229%27 HTTP/1.1" 200 None
2026-03-28 07:00:19 [auto1.nl] INFO: Scrape type for GA85229: 0
2026-03-28 07:00:19 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 07:00:19 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-28 07:00:19 [auto1.nl] INFO: Scrape type for CK37627: 2
2026-03-28 07:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbbe4059-1fbb-5df3-83de-5a1ec48ef961 with identifier: CK37627
2026-03-28 07:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbe4059-1fbb-5df3-83de-5a1ec48ef961 with scrape type 2
2026-03-28 07:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbbe4059-1fbb-5df3-83de-5a1ec48ef961 with scrape type 2
2026-03-28 07:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fbbe4059-1fbb-5df3-83de-5a1ec48ef961, identifier: CK37627
2026-03-28 07:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fbbe4059-1fbb-5df3-83de-5a1ec48ef961 with identifier: CK37627
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 07:00:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fbbe4059-1fbb-5df3-83de-5a1ec48ef961 with identifier: CK37627
2026-03-28 07:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fbbe4059-1fbb-5df3-83de-5a1ec48ef961 with identifier: CK37627 to the API
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:21:45Z',
'fuel_type': 'diesel',
'id': 'fbbe4059-1fbb-5df3-83de-5a1ec48ef961',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK37627',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 236173,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-26',
'seller_name': None,
'title': 'Mercedes-Benz Vito 116 CDI Kompakt',
'transmission': 'automatic',
'trim': 'Kompakt',
'year': 2017}
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-28 07:00:20 [auto1.nl] INFO: Saving data for CK37627: {'auction_closing_time': 1774714905.0, 'created_time': 1773837170.982668, 'last_price_update_time': 1774681220.617404}
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CK37627') HTTP/1.1" 204 0
2026-03-28 07:00:20 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-28 07:00:20 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-28 07:00:20 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-28 07:00:20 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-28 07:00:20 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 07:00:20 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 07:00:20 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-28 07:00:20 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-28 07:00:20 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 07:00:20 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-28 07:00:20 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-28 07:00:20 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-28 07:00:20 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-28 07:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:21 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:21 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW85568%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for XW85568: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR13994%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for AR13994: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA41421%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for CA41421: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for EX94963: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA54727%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for ZA54727: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX02996%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for BX02996: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for RY27630: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for FE12544: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG41463%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for CG41463: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV36091%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for FV36091: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SJ21377%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for SJ21377: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG42232%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for DG42232: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for NJ80961: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for PL67988: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU22503%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for EU22503: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS76145%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for CS76145: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA85229%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for GA85229: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for CK37627: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-28 07:00:22 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-28 07:00:22 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-28 07:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:23 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-28 07:00:23 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-28 07:00:23 [auto1.nl] INFO: Scrape type for KV59291: 0
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-28 07:00:23 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-28 07:00:23 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS44884%27 HTTP/1.1" 200 None
2026-03-28 07:00:23 [auto1.nl] INFO: Scrape type for YS44884: 2
2026-03-28 07:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff5b5a1-a032-52b7-9313-51eed3a020ec with identifier: YS44884
2026-03-28 07:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff5b5a1-a032-52b7-9313-51eed3a020ec with scrape type 2
2026-03-28 07:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ff5b5a1-a032-52b7-9313-51eed3a020ec with scrape type 2
2026-03-28 07:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ff5b5a1-a032-52b7-9313-51eed3a020ec, identifier: YS44884
2026-03-28 07:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ff5b5a1-a032-52b7-9313-51eed3a020ec with identifier: YS44884
2026-03-28 07:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 07:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ff5b5a1-a032-52b7-9313-51eed3a020ec with identifier: YS44884
2026-03-28 07:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ff5b5a1-a032-52b7-9313-51eed3a020ec with identifier: YS44884 to the API
2026-03-28 07:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:45:13Z',
'fuel_type': 'petrol',
'id': '9ff5b5a1-a032-52b7-9313-51eed3a020ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS44884',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 156451,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-04',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
'transmission': 'automatic',
'trim': 'Lounge BlueMotion Tech.',
'year': 2015}
2026-03-28 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS44884%27 HTTP/1.1" 200 None
2026-03-28 07:00:24 [auto1.nl] INFO: Saving data for YS44884: {'auction_closing_time': 1774716313.0, 'created_time': 1774465410.9781, 'last_price_update_time': 1774681224.959236}
2026-03-28 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YS44884') HTTP/1.1" 204 0
2026-03-28 07:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-28 07:00:25 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR86175%27 HTTP/1.1" 200 None
2026-03-28 07:00:25 [auto1.nl] INFO: Scrape type for UR86175: 0
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED59845%27 HTTP/1.1" 200 None
2026-03-28 07:00:25 [auto1.nl] INFO: Scrape type for ED59845: 0
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD39656%27 HTTP/1.1" 200 None
2026-03-28 07:00:25 [auto1.nl] INFO: Scrape type for SD39656: 0
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA17330%27 HTTP/1.1" 200 None
2026-03-28 07:00:25 [auto1.nl] INFO: Scrape type for DA17330: 0
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA05511%27 HTTP/1.1" 200 None
2026-03-28 07:00:25 [auto1.nl] INFO: Scrape type for GA05511: 0
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-28 07:00:25 [auto1.nl] INFO: Scrape type for NR95179: 0
2026-03-28 07:00:25 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS89953%27 HTTP/1.1" 200 None
2026-03-28 07:00:25 [auto1.nl] INFO: Scrape type for WS89953: 0
2026-03-28 07:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:26 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:26 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-28 07:00:26 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-28 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA68968%27 HTTP/1.1" 200 None
2026-03-28 07:00:26 [auto1.nl] INFO: Scrape type for AA68968: 0
2026-03-28 07:00:26 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-28 07:00:26 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-28 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-28 07:00:26 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-28 07:00:26 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-28 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-28 07:00:26 [auto1.nl] INFO: Scrape type for HK41309: 2
2026-03-28 07:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-28 07:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with scrape type 2
2026-03-28 07:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with scrape type 2
2026-03-28 07:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040, identifier: HK41309
2026-03-28 07:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-28 07:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-28 07:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309 to the API
2026-03-28 07:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-28T16:54:32Z',
'fuel_type': 'petrol',
'id': '5dc5bb30-2b38-5c98-8921-aa6df8ff1040',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK41309',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 186806,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-25',
'seller_name': None,
'title': 'Ford S-Max 2.0 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2012}
2026-03-28 07:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Saving data for HK41309: {'auction_closing_time': 1774716872.0, 'created_time': 1773301820.159804, 'last_price_update_time': 1774681228.006923}
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK41309') HTTP/1.1" 204 0
2026-03-28 07:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY12537%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for AY12537: 0
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA56403%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for SA56403: 0
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP01462%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for CP01462: 0
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: ZM76247
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZM76247%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for ZM76247: 0
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for FT93592: 0
2026-03-28 07:00:28 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF39374%27 HTTP/1.1" 200 None
2026-03-28 07:00:28 [auto1.nl] INFO: Scrape type for YF39374: 2
2026-03-28 07:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e654778f-a061-5bc3-bed5-dd1222c437fe with identifier: YF39374
2026-03-28 07:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e654778f-a061-5bc3-bed5-dd1222c437fe with scrape type 2
2026-03-28 07:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e654778f-a061-5bc3-bed5-dd1222c437fe with scrape type 2
2026-03-28 07:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e654778f-a061-5bc3-bed5-dd1222c437fe, identifier: YF39374
2026-03-28 07:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e654778f-a061-5bc3-bed5-dd1222c437fe with identifier: YF39374
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 07:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e654778f-a061-5bc3-bed5-dd1222c437fe with identifier: YF39374
2026-03-28 07:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e654778f-a061-5bc3-bed5-dd1222c437fe with identifier: YF39374 to the API
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:30:53Z',
'fuel_type': 'petrol',
'id': 'e654778f-a061-5bc3-bed5-dd1222c437fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF39374',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 183568,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-27',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2014}
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF39374%27 HTTP/1.1" 200 None
2026-03-28 07:00:29 [auto1.nl] INFO: Saving data for YF39374: {'auction_closing_time': 1774715453.0, 'created_time': 1774465408.931812, 'last_price_update_time': 1774681229.111253}
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YF39374') HTTP/1.1" 204 0
2026-03-28 07:00:29 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB15106%27 HTTP/1.1" 200 None
2026-03-28 07:00:29 [auto1.nl] INFO: Scrape type for KB15106: 0
2026-03-28 07:00:29 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-28 07:00:29 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG69964%27 HTTP/1.1" 200 None
2026-03-28 07:00:29 [auto1.nl] INFO: Scrape type for XG69964: 2
2026-03-28 07:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 286c33b2-e6eb-5391-88ec-f4a164edafa2 with identifier: XG69964
2026-03-28 07:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 286c33b2-e6eb-5391-88ec-f4a164edafa2 with scrape type 2
2026-03-28 07:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 286c33b2-e6eb-5391-88ec-f4a164edafa2 with scrape type 2
2026-03-28 07:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 286c33b2-e6eb-5391-88ec-f4a164edafa2, identifier: XG69964
2026-03-28 07:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 286c33b2-e6eb-5391-88ec-f4a164edafa2 with identifier: XG69964
2026-03-28 07:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 286c33b2-e6eb-5391-88ec-f4a164edafa2 with identifier: XG69964
2026-03-28 07:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 286c33b2-e6eb-5391-88ec-f4a164edafa2 with identifier: XG69964 to the API
2026-03-28 07:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:46:48Z',
'fuel_type': 'petrol',
'id': '286c33b2-e6eb-5391-88ec-f4a164edafa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG69964',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 93580,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-10',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG69964%27 HTTP/1.1" 200 None
2026-03-28 07:00:30 [auto1.nl] INFO: Saving data for XG69964: {'auction_closing_time': 1774716408.0, 'created_time': 1774465413.72629, 'last_price_update_time': 1774681230.747053}
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XG69964') HTTP/1.1" 204 0
2026-03-28 07:00:30 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-28 07:00:30 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-28 07:00:30 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU59495%27 HTTP/1.1" 200 None
2026-03-28 07:00:30 [auto1.nl] INFO: Scrape type for YU59495: 0
2026-03-28 07:00:30 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-28 07:00:30 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-28 07:00:30 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-28 07:00:30 [auto1.nl] INFO: Scrape type for EA94129: 0
2026-03-28 07:00:30 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-28 07:00:30 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR01730%27 HTTP/1.1" 200 None
2026-03-28 07:00:30 [auto1.nl] INFO: Scrape type for JR01730: 2
2026-03-28 07:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72a66a5e-a588-5671-a66a-8b236929ecb4 with identifier: JR01730
2026-03-28 07:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72a66a5e-a588-5671-a66a-8b236929ecb4 with scrape type 2
2026-03-28 07:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72a66a5e-a588-5671-a66a-8b236929ecb4 with scrape type 2
2026-03-28 07:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 72a66a5e-a588-5671-a66a-8b236929ecb4, identifier: JR01730
2026-03-28 07:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 72a66a5e-a588-5671-a66a-8b236929ecb4 with identifier: JR01730
2026-03-28 07:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 72a66a5e-a588-5671-a66a-8b236929ecb4 with identifier: JR01730
2026-03-28 07:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 72a66a5e-a588-5671-a66a-8b236929ecb4 with identifier: JR01730 to the API
2026-03-28 07:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:54:10Z',
'fuel_type': 'diesel',
'id': '72a66a5e-a588-5671-a66a-8b236929ecb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR01730',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 314744,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-12',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2012}
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR01730%27 HTTP/1.1" 200 None
2026-03-28 07:00:32 [auto1.nl] INFO: Saving data for JR01730: {'auction_closing_time': 1774716850.0, 'created_time': 1774465399.713017, 'last_price_update_time': 1774681232.631076}
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JR01730') HTTP/1.1" 204 0
2026-03-28 07:00:32 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-28 07:00:32 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-28 07:00:32 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ61661%27 HTTP/1.1" 200 None
2026-03-28 07:00:32 [auto1.nl] INFO: Scrape type for JJ61661: 0
2026-03-28 07:00:32 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK25571%27 HTTP/1.1" 200 None
2026-03-28 07:00:32 [auto1.nl] INFO: Scrape type for YK25571: 2
2026-03-28 07:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25dc86ce-7725-501d-83c9-e7129bf83d2b with identifier: YK25571
2026-03-28 07:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25dc86ce-7725-501d-83c9-e7129bf83d2b with scrape type 2
2026-03-28 07:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25dc86ce-7725-501d-83c9-e7129bf83d2b with scrape type 2
2026-03-28 07:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 25dc86ce-7725-501d-83c9-e7129bf83d2b, identifier: YK25571
2026-03-28 07:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 25dc86ce-7725-501d-83c9-e7129bf83d2b with identifier: YK25571
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 07:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 25dc86ce-7725-501d-83c9-e7129bf83d2b with identifier: YK25571
2026-03-28 07:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 25dc86ce-7725-501d-83c9-e7129bf83d2b with identifier: YK25571 to the API
2026-03-28 07:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:57:16Z',
'fuel_type': 'petrol',
'id': '25dc86ce-7725-501d-83c9-e7129bf83d2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK25571',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 192610,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-20',
'seller_name': None,
'title': 'Nissan Qashqai 2.0 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2011}
2026-03-28 07:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK25571%27 HTTP/1.1" 200 None
2026-03-28 07:00:34 [auto1.nl] INFO: Saving data for YK25571: {'auction_closing_time': 1774717036.0, 'created_time': 1774465403.801593, 'last_price_update_time': 1774681234.617888}
2026-03-28 07:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YK25571') HTTP/1.1" 204 0
2026-03-28 07:00:34 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-28 07:00:34 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-28 07:00:34 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-28 07:00:34 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-28 07:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:35 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:35 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-28 07:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU05681%27 HTTP/1.1" 200 None
2026-03-28 07:00:35 [auto1.nl] INFO: Scrape type for NU05681: 0
2026-03-28 07:00:35 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-28 07:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR57871%27 HTTP/1.1" 200 None
2026-03-28 07:00:35 [auto1.nl] INFO: Scrape type for NR57871: 2
2026-03-28 07:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f30e761-b8e4-55e7-b778-7dbb64b2ca70 with identifier: NR57871
2026-03-28 07:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f30e761-b8e4-55e7-b778-7dbb64b2ca70 with scrape type 2
2026-03-28 07:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f30e761-b8e4-55e7-b778-7dbb64b2ca70 with scrape type 2
2026-03-28 07:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0f30e761-b8e4-55e7-b778-7dbb64b2ca70, identifier: NR57871
2026-03-28 07:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0f30e761-b8e4-55e7-b778-7dbb64b2ca70 with identifier: NR57871
2026-03-28 07:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0f30e761-b8e4-55e7-b778-7dbb64b2ca70 with identifier: NR57871
2026-03-28 07:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0f30e761-b8e4-55e7-b778-7dbb64b2ca70 with identifier: NR57871 to the API
2026-03-28 07:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:18:00Z',
'fuel_type': 'petrol',
'id': '0f30e761-b8e4-55e7-b778-7dbb64b2ca70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR57871',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 172826,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-19',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR57871%27 HTTP/1.1" 200 None
2026-03-28 07:00:36 [auto1.nl] INFO: Saving data for NR57871: {'auction_closing_time': 1774714680.0, 'created_time': 1774465388.732303, 'last_price_update_time': 1774681236.448324}
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR57871') HTTP/1.1" 204 0
2026-03-28 07:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:36 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH03360%27 HTTP/1.1" 200 None
2026-03-28 07:00:36 [auto1.nl] INFO: Scrape type for CH03360: 0
2026-03-28 07:00:36 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ79748%27 HTTP/1.1" 200 None
2026-03-28 07:00:36 [auto1.nl] INFO: Scrape type for KZ79748: 0
2026-03-28 07:00:36 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 07:00:36 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY38299%27 HTTP/1.1" 200 None
2026-03-28 07:00:36 [auto1.nl] INFO: Scrape type for XY38299: 0
2026-03-28 07:00:36 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD45630%27 HTTP/1.1" 200 None
2026-03-28 07:00:36 [auto1.nl] INFO: Scrape type for TD45630: 0
2026-03-28 07:00:36 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS00430%27 HTTP/1.1" 200 None
2026-03-28 07:00:36 [auto1.nl] INFO: Scrape type for GS00430: 0
2026-03-28 07:00:36 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-28 07:00:36 [auto1.nl] INFO: Scrape type for VS32339: 2
2026-03-28 07:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850de4f1-5782-547a-86ca-dc8f47e78175 with identifier: VS32339
2026-03-28 07:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850de4f1-5782-547a-86ca-dc8f47e78175 with scrape type 2
2026-03-28 07:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850de4f1-5782-547a-86ca-dc8f47e78175 with scrape type 2
2026-03-28 07:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 850de4f1-5782-547a-86ca-dc8f47e78175, identifier: VS32339
2026-03-28 07:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 850de4f1-5782-547a-86ca-dc8f47e78175 with identifier: VS32339
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 07:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 850de4f1-5782-547a-86ca-dc8f47e78175 with identifier: VS32339
2026-03-28 07:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 850de4f1-5782-547a-86ca-dc8f47e78175 with identifier: VS32339 to the API
2026-03-28 07:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:25:02Z',
'fuel_type': 'petrol',
'id': '850de4f1-5782-547a-86ca-dc8f47e78175',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS32339',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 118911,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-27',
'seller_name': None,
'title': 'Peugeot 107 1.0 Petit Filou',
'transmission': 'manual',
'trim': 'Petit Filou',
'year': 2011}
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Saving data for VS32339: {'auction_closing_time': 1774715102.0, 'created_time': 1773232426.699619, 'last_price_update_time': 1774681237.597488}
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VS32339') HTTP/1.1" 204 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH26666%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for FH26666: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT03654%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for ZT03654: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EZ41839%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for EZ41839: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT38970%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for GT38970: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for DV35318: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR09014%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for KR09014: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ17478%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for BZ17478: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA42645%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for FA42645: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ53353%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for GJ53353: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ83139%27 HTTP/1.1" 200 None
2026-03-28 07:00:37 [auto1.nl] INFO: Scrape type for ZZ83139: 0
2026-03-28 07:00:37 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-28 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-28 07:00:38 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX18772%27 HTTP/1.1" 200 None
2026-03-28 07:00:38 [auto1.nl] INFO: Scrape type for VX18772: 2
2026-03-28 07:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3826ba5e-279b-53d6-b966-de57e68b362d with identifier: VX18772
2026-03-28 07:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3826ba5e-279b-53d6-b966-de57e68b362d with scrape type 2
2026-03-28 07:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3826ba5e-279b-53d6-b966-de57e68b362d with scrape type 2
2026-03-28 07:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3826ba5e-279b-53d6-b966-de57e68b362d, identifier: VX18772
2026-03-28 07:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3826ba5e-279b-53d6-b966-de57e68b362d with identifier: VX18772
2026-03-28 07:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3826ba5e-279b-53d6-b966-de57e68b362d with identifier: VX18772
2026-03-28 07:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3826ba5e-279b-53d6-b966-de57e68b362d with identifier: VX18772 to the API
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:35:20Z',
'fuel_type': 'diesel',
'id': '3826ba5e-279b-53d6-b966-de57e68b362d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX18772',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 242936,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-30',
'seller_name': None,
'title': 'Ford Fiesta 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX18772%27 HTTP/1.1" 200 None
2026-03-28 07:00:38 [auto1.nl] INFO: Saving data for VX18772: {'auction_closing_time': 1774715720.0, 'created_time': 1774465384.947019, 'last_price_update_time': 1774681238.43649}
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VX18772') HTTP/1.1" 204 0
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16373%27 HTTP/1.1" 200 None
2026-03-28 07:00:38 [auto1.nl] INFO: Scrape type for HT16373: 0
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-28 07:00:38 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN57581%27 HTTP/1.1" 200 None
2026-03-28 07:00:38 [auto1.nl] INFO: Scrape type for LN57581: 0
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-28 07:00:38 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-28 07:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:39 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC36011%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for MC36011: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR79727%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for WR79727: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT33504%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for CT33504: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG05474%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for PG05474: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for ZY63395: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for VW91946: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC20329%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for HC20329: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN01691%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for CN01691: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL96236%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for ZL96236: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX67409%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for JX67409: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF79856%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for BF79856: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP19214%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for WP19214: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN68466%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for KN68466: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-28 07:00:39 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-28 07:00:39 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-28 07:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:41 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW65450%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for DW65450: 2
2026-03-28 07:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c63238d-f95e-562e-b4fd-d6af26e0ffec with identifier: DW65450
2026-03-28 07:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c63238d-f95e-562e-b4fd-d6af26e0ffec with scrape type 2
2026-03-28 07:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c63238d-f95e-562e-b4fd-d6af26e0ffec with scrape type 2
2026-03-28 07:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9c63238d-f95e-562e-b4fd-d6af26e0ffec, identifier: DW65450
2026-03-28 07:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9c63238d-f95e-562e-b4fd-d6af26e0ffec with identifier: DW65450
2026-03-28 07:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9c63238d-f95e-562e-b4fd-d6af26e0ffec with identifier: DW65450
2026-03-28 07:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9c63238d-f95e-562e-b4fd-d6af26e0ffec with identifier: DW65450 to the API
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:11:30Z',
'fuel_type': 'diesel',
'id': '9c63238d-f95e-562e-b4fd-d6af26e0ffec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW65450',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 220295,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-29',
'seller_name': None,
'title': 'Ford Transit 2.4 TDE FT 330',
'transmission': 'manual',
'trim': 'FT 330',
'year': 2005}
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW65450%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Saving data for DW65450: {'auction_closing_time': 1774714290.0, 'created_time': 1774465400.462584, 'last_price_update_time': 1774681241.481623}
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW65450') HTTP/1.1" 204 0
2026-03-28 07:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for RL18676: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS82099%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for XS82099: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF50619%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for BF50619: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK19053%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for JK19053: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC72456%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for GC72456: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY67553%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for HY67553: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM38195%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for KM38195: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT29313%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for YT29313: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62268%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for HX62268: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE76328%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for BE76328: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG03602%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for TG03602: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH10928%27 HTTP/1.1" 200 None
2026-03-28 07:00:41 [auto1.nl] INFO: Scrape type for PH10928: 0
2026-03-28 07:00:41 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-28 07:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:43 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP13228%27 HTTP/1.1" 200 None
2026-03-28 07:00:43 [auto1.nl] INFO: Scrape type for CP13228: 0
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-28 07:00:43 [auto1.nl] INFO: Scrape type for MW67597: 0
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-28 07:00:43 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-28 07:00:43 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH25512%27 HTTP/1.1" 200 None
2026-03-28 07:00:43 [auto1.nl] INFO: Scrape type for HH25512: 0
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH67432%27 HTTP/1.1" 200 None
2026-03-28 07:00:43 [auto1.nl] INFO: Scrape type for LH67432: 0
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-28 07:00:43 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW17403%27 HTTP/1.1" 200 None
2026-03-28 07:00:43 [auto1.nl] INFO: Scrape type for TW17403: 2
2026-03-28 07:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77d0faf0-596c-5504-b4ef-be84ca12e267 with identifier: TW17403
2026-03-28 07:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d0faf0-596c-5504-b4ef-be84ca12e267 with scrape type 2
2026-03-28 07:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77d0faf0-596c-5504-b4ef-be84ca12e267 with scrape type 2
2026-03-28 07:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 77d0faf0-596c-5504-b4ef-be84ca12e267, identifier: TW17403
2026-03-28 07:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 77d0faf0-596c-5504-b4ef-be84ca12e267 with identifier: TW17403
2026-03-28 07:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 77d0faf0-596c-5504-b4ef-be84ca12e267 with identifier: TW17403
2026-03-28 07:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 77d0faf0-596c-5504-b4ef-be84ca12e267 with identifier: TW17403 to the API
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:09:52Z',
'fuel_type': 'petrol',
'id': '77d0faf0-596c-5504-b4ef-be84ca12e267',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW17403',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 191568,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-02',
'seller_name': None,
'title': 'Opel Zafira 2.2 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2008}
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW17403%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Saving data for TW17403: {'auction_closing_time': 1774714192.0, 'created_time': 1774465327.241366, 'last_price_update_time': 1774681244.053813}
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TW17403') HTTP/1.1" 204 0
2026-03-28 07:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG23592%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for WG23592: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY25778%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for SY25778: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC90690%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for VC90690: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT16898%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for TT16898: 0
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-28 07:00:44 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT83574%27 HTTP/1.1" 200 None
2026-03-28 07:00:44 [auto1.nl] INFO: Scrape type for KT83574: 0
2026-03-28 07:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:45 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-28 07:00:45 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-28 07:00:45 [auto1.nl] INFO: Scrape type for RX96199: 0
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VG54194%27 HTTP/1.1" 200 None
2026-03-28 07:00:45 [auto1.nl] INFO: Scrape type for VG54194: 2
2026-03-28 07:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 193d45dc-ec41-5e3f-a959-8596d24f718e with identifier: VG54194
2026-03-28 07:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 193d45dc-ec41-5e3f-a959-8596d24f718e with scrape type 2
2026-03-28 07:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 193d45dc-ec41-5e3f-a959-8596d24f718e with scrape type 2
2026-03-28 07:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 193d45dc-ec41-5e3f-a959-8596d24f718e, identifier: VG54194
2026-03-28 07:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 193d45dc-ec41-5e3f-a959-8596d24f718e with identifier: VG54194
2026-03-28 07:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 193d45dc-ec41-5e3f-a959-8596d24f718e with identifier: VG54194
2026-03-28 07:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 193d45dc-ec41-5e3f-a959-8596d24f718e with identifier: VG54194 to the API
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:26:07Z',
'fuel_type': 'diesel',
'id': '193d45dc-ec41-5e3f-a959-8596d24f718e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG54194',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Transporter',
'odometer': 274968,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-01',
'seller_name': None,
'title': 'Volkswagen T5 Transporter 2.5 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2008}
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VG54194%27 HTTP/1.1" 200 None
2026-03-28 07:00:45 [auto1.nl] INFO: Saving data for VG54194: {'auction_closing_time': 1774715167.0, 'created_time': 1774465417.546145, 'last_price_update_time': 1774681245.859034}
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VG54194') HTTP/1.1" 204 0
2026-03-28 07:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV23834%27 HTTP/1.1" 200 None
2026-03-28 07:00:45 [auto1.nl] INFO: Scrape type for TV23834: 0
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-28 07:00:45 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-28 07:00:45 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX49205%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for EX49205: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT16121%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for YT16121: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN01630%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for AN01630: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH82816%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for EH82816: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ17437%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for UJ17437: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU28768%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for PU28768: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for RC67109: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG85730%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for TG85730: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for GV74945: 2
2026-03-28 07:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fc44c0-77cd-575f-9093-fccb033c0131 with identifier: GV74945
2026-03-28 07:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fc44c0-77cd-575f-9093-fccb033c0131 with scrape type 2
2026-03-28 07:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43fc44c0-77cd-575f-9093-fccb033c0131 with scrape type 2
2026-03-28 07:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 43fc44c0-77cd-575f-9093-fccb033c0131, identifier: GV74945
2026-03-28 07:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 43fc44c0-77cd-575f-9093-fccb033c0131 with identifier: GV74945
2026-03-28 07:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 43fc44c0-77cd-575f-9093-fccb033c0131 with identifier: GV74945
2026-03-28 07:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 43fc44c0-77cd-575f-9093-fccb033c0131 with identifier: GV74945 to the API
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:29:58Z',
'fuel_type': 'petrol',
'id': '43fc44c0-77cd-575f-9093-fccb033c0131',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV74945',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 26384,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-06',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2021}
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Saving data for GV74945: {'auction_closing_time': 1774715398.0, 'created_time': 1774465394.29164, 'last_price_update_time': 1774681246.633587}
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV74945') HTTP/1.1" 204 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for YF67230: 0
2026-03-28 07:00:46 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC11957%27 HTTP/1.1" 200 None
2026-03-28 07:00:46 [auto1.nl] INFO: Scrape type for UC11957: 0
2026-03-28 07:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:00:47 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 916 | hits on page: 40
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG43530%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for WG43530: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH74159%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for UH74159: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for DX60140: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: GM40908
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM40908%27 HTTP/1.1" 200 None
2026-03-28 07:00:47 [auto1.nl] INFO: Scrape type for GM40908: 0
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-28 07:00:47 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-28 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW38124%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for PW38124: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS40359%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for HS40359: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for RT82599: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB77408%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for DB77408: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ43979%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for JJ43979: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for DF82688: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH74130%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for LH74130: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for DM34469: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC58229%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for KC58229: 0
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-28 07:00:48 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-28 07:00:48 [auto1.nl] INFO: Scrape type for PC64486: 0
2026-03-28 07:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:07 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 13 pages/min), scraped 15 items (at 15 items/min)
2026-03-28 07:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 07:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:19 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 916 | hits on page: 40
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF74045%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for TF74045: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL71745%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for SL71745: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB66825%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for ZB66825: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HU61188%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for HU61188: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV65488%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for AV65488: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC34005%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for EC34005: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for GD46513: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL46145%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for PL46145: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for YD79188: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA24721%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for JA24721: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for LT65669: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL58798%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for AL58798: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-28 07:01:19 [auto1.nl] INFO: Scrape type for RG26073: 0
2026-03-28 07:01:19 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-28 07:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:20 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 916 | hits on page: 40
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for HV97203: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW09535%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for RW09535: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN91004%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for ZN91004: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ67857%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for XZ67857: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for XJ86601: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV26065%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for TV26065: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX29422%27 HTTP/1.1" 200 None
2026-03-28 07:01:20 [auto1.nl] INFO: Scrape type for AX29422: 0
2026-03-28 07:01:20 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-28 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-28 07:01:21 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-28 07:01:21 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK25360%27 HTTP/1.1" 200 None
2026-03-28 07:01:21 [auto1.nl] INFO: Scrape type for ZK25360: 0
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-28 07:01:21 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-28 07:01:21 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-28 07:01:21 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-28 07:01:21 [auto1.nl] INFO: Scrape type for LA08041: 0
2026-03-28 07:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:22 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 916 | hits on page: 40
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: WV84251
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV84251%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for WV84251: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY73779%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for AY73779: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for TL32110: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for DS12539: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF65643%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for XF65643: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for JF28004: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE20026%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for UE20026: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ55104%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for FZ55104: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF83736%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for LF83736: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: GJ08711
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV49016%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for TV49016: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-28 07:01:22 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-28 07:01:22 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-28 07:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:23 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 916 | hits on page: 40
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM04115%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for HM04115: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: EL39193
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL39193%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for EL39193: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US61568%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for US61568: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH77322%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for WH77322: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for FD60498: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: HL48318
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: VN36525
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN36525%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for VN36525: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: NM97362
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM08403%27 HTTP/1.1" 200 None
2026-03-28 07:01:23 [auto1.nl] INFO: Scrape type for PM08403: 0
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-28 07:01:23 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-28 07:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:33 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX95579%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for LX95579: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK04481%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for KK04481: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: ZP63957
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: NS77626
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT27619%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for GT27619: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU17435%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for BU17435: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: FH97185
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH97185%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for FH97185: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG50012%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for GG50012: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: NM87332
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV31023%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for WV31023: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH92548%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for NH92548: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC46486%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for KC46486: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE07790%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for BE07790: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK39469%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for WK39469: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for CP88423: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA53958%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for VA53958: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF32327%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for MF32327: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: HC37182
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC37182%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for HC37182: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for AJ89396: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: CT04767
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT04767%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for CT04767: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM27085%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for DM27085: 0
2026-03-28 07:01:33 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM90003%27 HTTP/1.1" 200 None
2026-03-28 07:01:33 [auto1.nl] INFO: Scrape type for GM90003: 0
2026-03-28 07:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:34 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: LZ58703
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ58703%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for LZ58703: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX40194%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for DX40194: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: WB40041
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB40041%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for WB40041: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for GR22460: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV51543%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for UV51543: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: VH11794
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH11794%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for VH11794: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM39529%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for BM39529: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: XC91044
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for BN75332: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: CM13419
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE53949%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for CE53949: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: EX83153
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX83153%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for EX83153: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: DL78347
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: DX59899
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX59899%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for DX59899: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: WS72354
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS72354%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for WS72354: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: RD71224
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: CR11915
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-28 07:01:34 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-28 07:01:34 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-28 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: NL79871
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL79871%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for NL79871: 0
2026-03-28 07:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:35 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: WM00486
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM00486%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for WM00486: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: YM72619
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM72619%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for YM72619: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: UB53809
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: EL08717
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL08717%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for EL08717: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: HL89699
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-28 07:01:35 [auto1.nl] INFO: Scrape type for HF10176: 0
2026-03-28 07:01:35 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-28 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB01407%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for KB01407: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: NB67844
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB67844%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for NB67844: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: TY02674
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY02674%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for TY02674: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP30662%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for HP30662: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: MZ83148
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ83148%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for MZ83148: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: TF88410
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF88410%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for TF88410: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: YK64597
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK64597%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for YK64597: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: VP87797
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: NS74153
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM09418%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for SM09418: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: NN84532
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: FZ65940
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: TL21960
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL21960%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for TL21960: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: MV90025
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV90025%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for MV90025: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: GJ92310
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG47676%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for UG47676: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: AE22840
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE22840%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for AE22840: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-28 07:01:36 [auto1.nl] INFO: Found listing with ID: WU52252
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU52252%27 HTTP/1.1" 200 None
2026-03-28 07:01:36 [auto1.nl] INFO: Scrape type for WU52252: 0
2026-03-28 07:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:37 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:37 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-28 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-28 07:01:37 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-28 07:01:37 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-28 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-28 07:01:37 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-28 07:01:37 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-28 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-28 07:01:37 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-28 07:01:37 [auto1.nl] INFO: Found listing with ID: FB31523
2026-03-28 07:01:37 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: DV95890
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV95890%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for DV95890: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: FG40185
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG40185%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for FG40185: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: GZ83628
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ83628%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for GZ83628: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: NA39376
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: JY58487
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: NG63197
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG63197%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for NG63197: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: UD56346
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD56346%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for UD56346: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-28 07:01:38 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-28 07:01:38 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-28 07:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:39 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: HH96879
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH96879%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for HH96879: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: NY79842
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY79842%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for NY79842: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: LR65933
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: TJ92302
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ92302%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for TJ92302: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-28 07:01:39 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-28 07:01:39 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 07:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:40 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: JK11532
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK11532%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for JK11532: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: HK93829
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK93829%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for HK93829: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: RF47261
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB63193%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for FB63193: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-28 07:01:40 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-28 07:01:40 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ87309%27 HTTP/1.1" 200 None
2026-03-28 07:01:41 [auto1.nl] INFO: Scrape type for JJ87309: 0
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-28 07:01:41 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-28 07:01:41 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-28 07:01:41 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-28 07:01:41 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-28 07:01:41 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-28 07:01:41 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-28 07:01:41 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-28 07:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:42 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS58210%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for WS58210: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US57687%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for US57687: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB05434%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for AB05434: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: AB92284
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB92284%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for AB92284: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55872%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for EF55872: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ45732%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for TJ45732: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for GA80832: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT08140%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for UT08140: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY14996%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for LY14996: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC04146%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for UC04146: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB37816%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for UB37816: 0
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-28 07:01:42 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX38555%27 HTTP/1.1" 200 None
2026-03-28 07:01:42 [auto1.nl] INFO: Scrape type for GX38555: 0
2026-03-28 07:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:43 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU82988%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for YU82988: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for VM29173: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RR80165%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for RR80165: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-28 07:01:43 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-28 07:01:43 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-28 07:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:44 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 917 | hits on page: 40
2026-03-28 07:01:44 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-28 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX92385%27 HTTP/1.1" 200 None
2026-03-28 07:01:44 [auto1.nl] INFO: Scrape type for FX92385: 0
2026-03-28 07:01:44 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-28 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-28 07:01:44 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-28 07:01:44 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-28 07:01:44 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-28 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-28 07:01:44 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-28 07:01:44 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-28 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH84557%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for DH84557: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS82995%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for FS82995: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ95506%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for LJ95506: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59485%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for HH59485: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-28 07:01:45 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-28 07:01:45 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-28 07:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:46 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 917 | hits on page: 37
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG94378%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for BG94378: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ44063%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for ZZ44063: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51310%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for DK51310: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK51232%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for ZK51232: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-28 07:01:46 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-28 07:01:46 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-28 07:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:01:47 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 917 | hits on page: 0
2026-03-28 07:01:47 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 07:01:47 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-28 07:01:47 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 296, <ScrapeType.BATCH_SKIPPED: 5>: 304}
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774249308 HTTP/1.1" 200 None
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB91317') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AC58104') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AG78664') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AM42063') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY82778') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ21831') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA87622') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DH83344') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR41045') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR68176') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP65651') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV35300') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JE58423') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JR03382') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA06731') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LZ20113') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ND76510') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ND88147') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NF29508') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX06020') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PT21258') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY99234') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RB40697') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RG15151') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SH64324') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TG75227') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TX69728') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF27359') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UG26454') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UZ85688') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD03241') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XB61944') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XE39844') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YA06880') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT28903') HTTP/1.1" 204 0
2026-03-28 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG49112') HTTP/1.1" 204 0
2026-03-28 07:01:48 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (15 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-28T07_00_00.jl
2026-03-28 07:01:48 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 75815,
'downloader/request_count': 28,
'downloader/request_method_count/GET': 2,
'downloader/request_method_count/POST': 26,
'downloader/response_bytes': 4183497,
'downloader/response_count': 28,
'downloader/response_status_count/200': 28,
'elapsed_time_seconds': 101.411711,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 28, 7, 1, 48, 456161, tzinfo=datetime.timezone.utc),
'item_scraped_count': 15,
'log_count/DEBUG': 1194,
'log_count/INFO': 1636,
'memusage/max': 162639872,
'memusage/startup': 147705856,
'request_depth_max': 27,
'response_received_count': 28,
'scheduler/dequeued': 28,
'scheduler/dequeued/memory': 28,
'scheduler/enqueued': 28,
'scheduler/enqueued/memory': 28,
'scrape_type/batch_skipped': 474,
'scrape_type/price_update': 15,
'scrape_type/skipped': 468,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 28,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.6089355020085354,
'scrapy-zyte-api/mean_response_seconds': 2.7432276226380568,
'scrapy-zyte-api/processed': 28,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 28,
'scrapy-zyte-api/request_args/experimental.requestCookies': 27,
'scrapy-zyte-api/request_args/experimental.responseCookies': 28,
'scrapy-zyte-api/request_args/httpRequestBody': 26,
'scrapy-zyte-api/request_args/httpRequestMethod': 26,
'scrapy-zyte-api/request_args/httpResponseBody': 28,
'scrapy-zyte-api/request_args/httpResponseHeaders': 28,
'scrapy-zyte-api/request_args/sessionContext': 28,
'scrapy-zyte-api/request_args/url': 28,
'scrapy-zyte-api/status_codes/200': 28,
'scrapy-zyte-api/success': 28,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 957,
'source/total_available': 917,
'start_time': datetime.datetime(2026, 3, 28, 7, 0, 7, 44450, tzinfo=datetime.timezone.utc)}
2026-03-28 07:01:48 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 07:01:48 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f7af94f77d0>
2026-03-28 07:01:48 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f7af94c8650>