2026-03-29 07:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 07:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 07:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-29 07:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-29 07:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 07:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 07:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 07:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 07:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: bbb8192ba0d5d1f1
2026-03-29 07:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 07:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-29T07_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 07:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 07:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 07:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 07:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 07:00:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 07:00:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 07:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 07:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-29 07:00:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 07:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 07:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 07:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 07:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 07:00:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 07:00:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 07:00:07 [scrapy.core.engine] INFO: Spider opened
2026-03-29 07:00:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 07:00:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 07:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 07:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-29 07:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-29 07:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 07:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 07:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 07:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 07:00:17 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for EP75091: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for PT29526: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for LT58475: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for ZU81802: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for AR18023: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for VV23298: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for TA68954: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for MC92565: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-29 07:00:17 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-29 07:00:17 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-29 07:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:00:20 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for EP75091: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for PT29526: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for LT58475: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for ZU81802: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for AR18023: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for VV23298: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for TA68954: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for MC92565: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-29 07:00:20 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-29 07:00:20 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-29 07:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:00:22 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-29 07:00:22 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-29 07:00:22 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-29 07:00:22 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-29 07:00:22 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-29 07:00:22 [auto1.nl] INFO: Scrape type for KZ09082: 2
2026-03-29 07:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-29 07:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with scrape type 2
2026-03-29 07:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with scrape type 2
2026-03-29 07:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04bb139e-4ba8-5b53-8e2a-f325bcea1619, identifier: KZ09082
2026-03-29 07:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 07:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 07:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-29 07:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082 to the API
2026-03-29 07:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:40:42Z',
 'fuel_type': 'petrol',
 'id': '04bb139e-4ba8-5b53-8e2a-f325bcea1619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ09082',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 196832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo ON Start/Stop',
 'transmission': 'manual',
 'trim': 'ON Start/Stop',
 'year': 2018}
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-29 07:00:23 [auto1.nl] INFO: Saving data for KZ09082: {'auction_closing_time': 1774885242.0, 'created_time': 1774551743.047535, 'last_price_update_time': 1774767623.480429}
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ09082') HTTP/1.1" 204 0
2026-03-29 07:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-29 07:00:23 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-29 07:00:23 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-29 07:00:23 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-29 07:00:23 [auto1.nl] INFO: Scrape type for DM34469: 0
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-29 07:00:23 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-29 07:00:23 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-29 07:00:23 [auto1.nl] INFO: Scrape type for VJ06664: 2
2026-03-29 07:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-29 07:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b92ad5-3716-5892-9868-65c8b7f4ef54 with scrape type 2
2026-03-29 07:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56b92ad5-3716-5892-9868-65c8b7f4ef54 with scrape type 2
2026-03-29 07:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56b92ad5-3716-5892-9868-65c8b7f4ef54, identifier: VJ06664
2026-03-29 07:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-29 07:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-29 07:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664 to the API
2026-03-29 07:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:22:10Z',
 'fuel_type': 'petrol',
 'id': '56b92ad5-3716-5892-9868-65c8b7f4ef54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ06664',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 205142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-13',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2015}
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-29 07:00:24 [auto1.nl] INFO: Saving data for VJ06664: {'auction_closing_time': 1774884130.0, 'created_time': 1774551745.270679, 'last_price_update_time': 1774767624.539748}
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VJ06664') HTTP/1.1" 204 0
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-29 07:00:24 [auto1.nl] INFO: Scrape type for ET47420: 0
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-29 07:00:24 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-29 07:00:24 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-29 07:00:24 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-29 07:00:24 [auto1.nl] INFO: Scrape type for FP10265: 2
2026-03-29 07:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-29 07:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ecd506-7c44-5c1c-acff-874e7fe5348e with scrape type 2
2026-03-29 07:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ecd506-7c44-5c1c-acff-874e7fe5348e with scrape type 2
2026-03-29 07:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02ecd506-7c44-5c1c-acff-874e7fe5348e, identifier: FP10265
2026-03-29 07:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 07:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-29 07:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265 to the API
2026-03-29 07:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:09:44Z',
 'fuel_type': 'petrol',
 'id': '02ecd506-7c44-5c1c-acff-874e7fe5348e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP10265',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 140399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-29 07:00:26 [auto1.nl] INFO: Saving data for FP10265: {'auction_closing_time': 1774883384.0, 'created_time': 1774551686.012455, 'last_price_update_time': 1774767626.401049}
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP10265') HTTP/1.1" 204 0
2026-03-29 07:00:26 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-29 07:00:26 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-29 07:00:26 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-29 07:00:26 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-29 07:00:26 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-29 07:00:26 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-29 07:00:26 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-29 07:00:26 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-29 07:00:26 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-29 07:00:26 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-29 07:00:26 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-29 07:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:00:37 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:37 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-29 07:00:37 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-29 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-29 07:00:37 [auto1.nl] INFO: Scrape type for PY50820: 2
2026-03-29 07:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-29 07:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf92713-ab07-5644-a46f-ff781cdc5926 with scrape type 2
2026-03-29 07:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf92713-ab07-5644-a46f-ff781cdc5926 with scrape type 2
2026-03-29 07:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: acf92713-ab07-5644-a46f-ff781cdc5926, identifier: PY50820
2026-03-29 07:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 07:00:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-29 07:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820 to the API
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:20Z',
 'fuel_type': 'petrol',
 'id': 'acf92713-ab07-5644-a46f-ff781cdc5926',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY50820',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 197757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-11',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-29 07:00:38 [auto1.nl] INFO: Saving data for PY50820: {'auction_closing_time': 1774884500.0, 'created_time': 1774551764.59255, 'last_price_update_time': 1774767638.559407}
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY50820') HTTP/1.1" 204 0
2026-03-29 07:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:38 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-29 07:00:38 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-29 07:00:38 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-29 07:00:38 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-29 07:00:38 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-29 07:00:38 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-29 07:00:38 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-29 07:00:38 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-29 07:00:38 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-29 07:00:38 [auto1.nl] INFO: Scrape type for MB44193: 2
2026-03-29 07:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-29 07:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0aa2321-5a6a-5140-a6b9-eda5979076f8 with scrape type 2
2026-03-29 07:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0aa2321-5a6a-5140-a6b9-eda5979076f8 with scrape type 2
2026-03-29 07:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0aa2321-5a6a-5140-a6b9-eda5979076f8, identifier: MB44193
2026-03-29 07:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-29 07:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-29 07:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193 to the API
2026-03-29 07:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:10:44Z',
 'fuel_type': 'petrol',
 'id': 'f0aa2321-5a6a-5140-a6b9-eda5979076f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB44193',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 151351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
 'transmission': 'automatic',
 'trim': 'Lounge BlueMotion Tech.',
 'year': 2015}
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-29 07:00:39 [auto1.nl] INFO: Saving data for MB44193: {'auction_closing_time': 1774883444.0, 'created_time': 1774551711.717702, 'last_price_update_time': 1774767639.256634}
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB44193') HTTP/1.1" 204 0
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-29 07:00:39 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-29 07:00:39 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-29 07:00:39 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-29 07:00:39 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-29 07:00:39 [auto1.nl] INFO: Scrape type for VM45476: 0
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-29 07:00:39 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-29 07:00:39 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-29 07:00:39 [auto1.nl] INFO: Scrape type for CF65603: 2
2026-03-29 07:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-29 07:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6324a6d6-438e-50e6-a90d-82c21e38832e with scrape type 2
2026-03-29 07:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6324a6d6-438e-50e6-a90d-82c21e38832e with scrape type 2
2026-03-29 07:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6324a6d6-438e-50e6-a90d-82c21e38832e, identifier: CF65603
2026-03-29 07:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 07:00:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-29 07:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603 to the API
2026-03-29 07:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:41:07Z',
 'fuel_type': 'hybrid',
 'id': '6324a6d6-438e-50e6-a90d-82c21e38832e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF65603',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 193306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2021}
2026-03-29 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-29 07:00:40 [auto1.nl] INFO: Saving data for CF65603: {'auction_closing_time': 1774885267.0, 'created_time': 1774551739.185534, 'last_price_update_time': 1774767640.859225}
2026-03-29 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF65603') HTTP/1.1" 204 0
2026-03-29 07:00:40 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-29 07:00:40 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-29 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-29 07:00:40 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-29 07:00:40 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-29 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-29 07:00:41 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-29 07:00:41 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-29 07:00:41 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-29 07:00:41 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-29 07:00:41 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-29 07:00:41 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-29 07:00:41 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-29 07:00:41 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-29 07:00:41 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-29 07:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:00:42 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-29 07:00:42 [auto1.nl] INFO: Scrape type for SE99372: 0
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-29 07:00:42 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-29 07:00:42 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-29 07:00:42 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-29 07:00:42 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-29 07:00:42 [auto1.nl] INFO: Scrape type for MD48743: 2
2026-03-29 07:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-29 07:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c02319c7-2ebf-5420-b7a4-cd9ece6d95de with scrape type 2
2026-03-29 07:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c02319c7-2ebf-5420-b7a4-cd9ece6d95de with scrape type 2
2026-03-29 07:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c02319c7-2ebf-5420-b7a4-cd9ece6d95de, identifier: MD48743
2026-03-29 07:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-29 07:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-29 07:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743 to the API
2026-03-29 07:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:17:29Z',
 'fuel_type': 'hybrid',
 'id': 'c02319c7-2ebf-5420-b7a4-cd9ece6d95de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD48743',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 198005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-29 07:00:43 [auto1.nl] INFO: Saving data for MD48743: {'auction_closing_time': 1774883849.0, 'created_time': 1774551763.808433, 'last_price_update_time': 1774767643.737026}
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD48743') HTTP/1.1" 204 0
2026-03-29 07:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:43 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-29 07:00:43 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-29 07:00:43 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-29 07:00:43 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-29 07:00:43 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-29 07:00:43 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-29 07:00:43 [auto1.nl] INFO: Scrape type for GW56825: 2
2026-03-29 07:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-29 07:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0d4bc6-5221-5ed1-a467-12223b37b200 with scrape type 2
2026-03-29 07:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0d4bc6-5221-5ed1-a467-12223b37b200 with scrape type 2
2026-03-29 07:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c0d4bc6-5221-5ed1-a467-12223b37b200, identifier: GW56825
2026-03-29 07:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-29 07:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-29 07:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825 to the API
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:32:17Z',
 'fuel_type': 'petrol',
 'id': '3c0d4bc6-5221-5ed1-a467-12223b37b200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW56825',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 65653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-14',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2011}
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-29 07:00:44 [auto1.nl] INFO: Saving data for GW56825: {'auction_closing_time': 1774884737.0, 'created_time': 1773131953.305068, 'last_price_update_time': 1774767644.368788}
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW56825') HTTP/1.1" 204 0
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-29 07:00:44 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-29 07:00:44 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-29 07:00:44 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-29 07:00:44 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-29 07:00:44 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-29 07:00:44 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-29 07:00:44 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-29 07:00:44 [auto1.nl] INFO: Scrape type for CM82546: 2
2026-03-29 07:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-29 07:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133c9cb0-e881-5240-b8eb-788fa3c341b6 with scrape type 2
2026-03-29 07:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 133c9cb0-e881-5240-b8eb-788fa3c341b6 with scrape type 2
2026-03-29 07:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 133c9cb0-e881-5240-b8eb-788fa3c341b6, identifier: CM82546
2026-03-29 07:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-29 07:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-29 07:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546 to the API
2026-03-29 07:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:06:30Z',
 'fuel_type': 'petrol',
 'id': '133c9cb0-e881-5240-b8eb-788fa3c341b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM82546',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-06',
 'seller_name': None,
 'title': 'BMW 3er 325i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2006}
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Saving data for CM82546: {'auction_closing_time': 1774883190.0, 'created_time': 1774551704.471483, 'last_price_update_time': 1774767645.598931}
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM82546') HTTP/1.1" 204 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for HX69861: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-29 07:00:45 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-29 07:00:45 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-29 07:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:00:46 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:46 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-29 07:00:46 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-29 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-29 07:00:46 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-29 07:00:46 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-29 07:00:46 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-29 07:00:46 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-29 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-29 07:00:46 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-29 07:00:46 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-29 07:00:46 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-29 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-29 07:00:46 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-29 07:00:46 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-29 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-29 07:00:46 [auto1.nl] INFO: Scrape type for CL96583: 2
2026-03-29 07:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-29 07:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1692a952-d16e-5319-b4b5-5c957492c775 with scrape type 2
2026-03-29 07:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1692a952-d16e-5319-b4b5-5c957492c775 with scrape type 2
2026-03-29 07:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1692a952-d16e-5319-b4b5-5c957492c775, identifier: CL96583
2026-03-29 07:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 07:00:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-29 07:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583 to the API
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 173,
 'expiration_date': '2026-03-30T15:12:43Z',
 'fuel_type': 'petrol',
 'id': '1692a952-d16e-5319-b4b5-5c957492c775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL96583',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 160186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-15',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.7 V6 GLS',
 'transmission': 'automatic',
 'trim': 'GLS',
 'year': 2002}
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Saving data for CL96583: {'auction_closing_time': 1774883563.0, 'created_time': 1774551746.138415, 'last_price_update_time': 1774767647.589833}
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CL96583') HTTP/1.1" 204 0
2026-03-29 07:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-29 07:00:47 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-29 07:00:47 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-29 07:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:00:49 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:49 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-29 07:00:49 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-29 07:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-29 07:00:49 [auto1.nl] INFO: Scrape type for MX82019: 2
2026-03-29 07:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-29 07:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88ee384-b91f-5b59-a7d9-8d318cb9e052 with scrape type 2
2026-03-29 07:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88ee384-b91f-5b59-a7d9-8d318cb9e052 with scrape type 2
2026-03-29 07:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f88ee384-b91f-5b59-a7d9-8d318cb9e052, identifier: MX82019
2026-03-29 07:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-29 07:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:00:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 07:00:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-29 07:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019 to the API
2026-03-29 07:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:35:07Z',
 'fuel_type': 'petrol',
 'id': 'f88ee384-b91f-5b59-a7d9-8d318cb9e052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX82019',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 214768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-08-26',
 'seller_name': None,
 'title': 'Lancia Delta 1.6 HPE',
 'transmission': 'manual',
 'trim': 'HPE',
 'year': 1999}
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-29 07:00:50 [auto1.nl] INFO: Saving data for MX82019: {'auction_closing_time': 1774884907.0, 'created_time': 1774551749.529035, 'last_price_update_time': 1774767650.187603}
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX82019') HTTP/1.1" 204 0
2026-03-29 07:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:50 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-29 07:00:50 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-29 07:00:50 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-29 07:00:50 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-29 07:00:50 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-29 07:00:50 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-29 07:00:50 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-29 07:00:50 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-29 07:00:50 [auto1.nl] INFO: Scrape type for NK23750: 2
2026-03-29 07:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-29 07:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 022e46ed-f385-5f97-9025-5398e8a74e7f with scrape type 2
2026-03-29 07:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 022e46ed-f385-5f97-9025-5398e8a74e7f with scrape type 2
2026-03-29 07:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 022e46ed-f385-5f97-9025-5398e8a74e7f, identifier: NK23750
2026-03-29 07:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-29 07:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-29 07:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750 to the API
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:20Z',
 'fuel_type': 'petrol',
 'id': '022e46ed-f385-5f97-9025-5398e8a74e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK23750',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 102673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-02',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-29 07:00:50 [auto1.nl] INFO: Saving data for NK23750: {'auction_closing_time': 1774885760.0, 'created_time': 1774551765.94995, 'last_price_update_time': 1774767650.849745}
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NK23750') HTTP/1.1" 204 0
2026-03-29 07:00:50 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-29 07:00:50 [auto1.nl] INFO: Scrape type for LT61011: 2
2026-03-29 07:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-29 07:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 895f6ddb-d43d-5cb7-acbc-65874857d224 with scrape type 2
2026-03-29 07:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 895f6ddb-d43d-5cb7-acbc-65874857d224 with scrape type 2
2026-03-29 07:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 895f6ddb-d43d-5cb7-acbc-65874857d224, identifier: LT61011
2026-03-29 07:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-29 07:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 07:00:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 07:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-29 07:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011 to the API
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:14:45Z',
 'fuel_type': 'diesel',
 'id': '895f6ddb-d43d-5cb7-acbc-65874857d224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT61011',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 77777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 108 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2020}
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-29 07:00:51 [auto1.nl] INFO: Saving data for LT61011: {'auction_closing_time': 1774883685.0, 'created_time': 1774551751.131415, 'last_price_update_time': 1774767651.48465}
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT61011') HTTP/1.1" 204 0
2026-03-29 07:00:51 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-29 07:00:51 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-29 07:00:51 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-29 07:00:51 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-29 07:00:51 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-29 07:00:51 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-29 07:00:51 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-29 07:00:51 [auto1.nl] INFO: Scrape type for EK38089: 2
2026-03-29 07:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-29 07:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45020602-a651-5b28-9158-191f691320fe with scrape type 2
2026-03-29 07:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45020602-a651-5b28-9158-191f691320fe with scrape type 2
2026-03-29 07:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 45020602-a651-5b28-9158-191f691320fe, identifier: EK38089
2026-03-29 07:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-29 07:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-29 07:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089 to the API
2026-03-29 07:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:11:18Z',
 'fuel_type': 'petrol',
 'id': '45020602-a651-5b28-9158-191f691320fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK38089',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 179285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-11',
 'seller_name': None,
 'title': 'BMW 6er 640i GT xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-29 07:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-29 07:00:52 [auto1.nl] INFO: Saving data for EK38089: {'auction_closing_time': 1774883478.0, 'created_time': 1774551723.723329, 'last_price_update_time': 1774767652.970037}
2026-03-29 07:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK38089') HTTP/1.1" 204 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-29 07:00:53 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-29 07:00:53 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-29 07:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:00:54 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:54 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-29 07:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-29 07:00:54 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-29 07:00:54 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-29 07:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-29 07:00:54 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-29 07:00:54 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-29 07:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-29 07:00:54 [auto1.nl] INFO: Scrape type for CU35423: 2
2026-03-29 07:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-29 07:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9282a218-25b8-5356-aade-50a8a0dde52e with scrape type 2
2026-03-29 07:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9282a218-25b8-5356-aade-50a8a0dde52e with scrape type 2
2026-03-29 07:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9282a218-25b8-5356-aade-50a8a0dde52e, identifier: CU35423
2026-03-29 07:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-29 07:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-29 07:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423 to the API
2026-03-29 07:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:23:03Z',
 'fuel_type': 'diesel',
 'id': '9282a218-25b8-5356-aade-50a8a0dde52e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU35423',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 106521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2011}
2026-03-29 07:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-29 07:00:55 [auto1.nl] INFO: Saving data for CU35423: {'auction_closing_time': 1774884183.0, 'created_time': 1774551744.548415, 'last_price_update_time': 1774767655.869155}
2026-03-29 07:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CU35423') HTTP/1.1" 204 0
2026-03-29 07:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:55 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-29 07:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for XW28642: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for UF74705: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for EN44222: 2
2026-03-29 07:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-29 07:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with scrape type 2
2026-03-29 07:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with scrape type 2
2026-03-29 07:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd, identifier: EN44222
2026-03-29 07:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-29 07:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-29 07:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222 to the API
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:13:18Z',
 'fuel_type': 'petrol',
 'id': 'c5274c10-ce3f-5dfb-99be-7ac258ac4ebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN44222',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 302205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-19',
 'seller_name': None,
 'title': 'BMW 5er 535i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Saving data for EN44222: {'auction_closing_time': 1774883598.0, 'created_time': 1774465303.361222, 'last_price_update_time': 1774767656.713082}
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EN44222') HTTP/1.1" 204 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-29 07:00:56 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-29 07:00:56 [auto1.nl] INFO: Scrape type for VH08569: 2
2026-03-29 07:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-29 07:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with scrape type 2
2026-03-29 07:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with scrape type 2
2026-03-29 07:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56d29233-5f25-5e4f-aa4e-14eabb0861d5, identifier: VH08569
2026-03-29 07:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-29 07:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-29 07:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569 to the API
2026-03-29 07:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'petrol',
 'id': '56d29233-5f25-5e4f-aa4e-14eabb0861d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH08569',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 121516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Turbo S ecoFlex',
 'transmission': 'manual',
 'trim': 'S ecoFlex',
 'year': 2018}
2026-03-29 07:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-29 07:00:57 [auto1.nl] INFO: Saving data for VH08569: {'auction_closing_time': 1774884897.0, 'created_time': 1774551754.674923, 'last_price_update_time': 1774767657.365756}
2026-03-29 07:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH08569') HTTP/1.1" 204 0
2026-03-29 07:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:00:58 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 643 | hits on page: 40
2026-03-29 07:00:58 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-29 07:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-29 07:00:58 [auto1.nl] INFO: Scrape type for AY58936: 2
2026-03-29 07:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-29 07:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d280cf38-61cc-5994-9096-9b17c21252fe with scrape type 2
2026-03-29 07:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d280cf38-61cc-5994-9096-9b17c21252fe with scrape type 2
2026-03-29 07:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d280cf38-61cc-5994-9096-9b17c21252fe, identifier: AY58936
2026-03-29 07:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-29 07:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-29 07:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936 to the API
2026-03-29 07:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:20:14Z',
 'fuel_type': 'petrol',
 'id': 'd280cf38-61cc-5994-9096-9b17c21252fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY58936',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 174784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-18',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Nismo',
 'transmission': 'manual',
 'trim': 'Nismo',
 'year': 2014}
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Saving data for AY58936: {'auction_closing_time': 1774884014.0, 'created_time': 1774353784.375024, 'last_price_update_time': 1774767659.011625}
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY58936') HTTP/1.1" 204 0
2026-03-29 07:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for DA29812: 2
2026-03-29 07:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-29 07:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with scrape type 2
2026-03-29 07:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with scrape type 2
2026-03-29 07:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9, identifier: DA29812
2026-03-29 07:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-29 07:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-29 07:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812 to the API
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:00:11Z',
 'fuel_type': 'petrol',
 'id': '119cd623-a1bd-52d3-bf5f-c55fcd9bdda9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA29812',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 35303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Saving data for DA29812: {'auction_closing_time': 1774882811.0, 'created_time': 1774551752.070022, 'last_price_update_time': 1774767659.676192}
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA29812') HTTP/1.1" 204 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for AM42063: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-29 07:00:59 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-29 07:00:59 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-29 07:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-29 07:01:00 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-29 07:01:00 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-29 07:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-29 07:01:00 [auto1.nl] INFO: Scrape type for FH88416: 2
2026-03-29 07:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-29 07:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2944f94-8a96-50e1-9b6c-ee20ed28183f with scrape type 2
2026-03-29 07:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2944f94-8a96-50e1-9b6c-ee20ed28183f with scrape type 2
2026-03-29 07:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2944f94-8a96-50e1-9b6c-ee20ed28183f, identifier: FH88416
2026-03-29 07:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-29 07:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-29 07:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416 to the API
2026-03-29 07:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 07:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 07:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:26:36Z',
 'fuel_type': 'petrol',
 'id': 'f2944f94-8a96-50e1-9b6c-ee20ed28183f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH88416',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 90728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2010}
2026-03-29 07:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-29 07:01:02 [auto1.nl] INFO: Saving data for FH88416: {'auction_closing_time': 1774884396.0, 'created_time': 1774551761.859179, 'last_price_update_time': 1774767662.001448}
2026-03-29 07:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH88416') HTTP/1.1" 204 0
2026-03-29 07:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:03 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 643 | hits on page: 40
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for LS97590: 0
2026-03-29 07:01:03 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-29 07:01:03 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-29 07:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:07 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 13 pages/min), scraped 20 items (at 20 items/min)
2026-03-29 07:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 07:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:36 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 643 | hits on page: 40
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for KP34214: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-29 07:01:36 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-29 07:01:36 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-29 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for KV59291: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-29 07:01:37 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-29 07:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:37 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 643 | hits on page: 40
2026-03-29 07:01:37 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for MX73700: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for KW64079: 0
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-29 07:01:38 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-29 07:01:38 [auto1.nl] INFO: Scrape type for GV91252: 0
2026-03-29 07:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:39 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 643 | hits on page: 40
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for VE70887: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for TY41517: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for WP58537: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for LE21715: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for JH71745: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for BL89669: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for HN54837: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for XK63885: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for BJ61509: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for RH72913: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for SR45817: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for EC40520: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for LL30088: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for SN61945: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for ZK31432: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-29 07:01:39 [auto1.nl] INFO: Scrape type for GN14496: 0
2026-03-29 07:01:39 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-29 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-29 07:01:40 [auto1.nl] INFO: Scrape type for WH58354: 0
2026-03-29 07:01:40 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-29 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-29 07:01:40 [auto1.nl] INFO: Scrape type for VZ88435: 0
2026-03-29 07:01:40 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-29 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK58084%27 HTTP/1.1" 200 None
2026-03-29 07:01:40 [auto1.nl] INFO: Scrape type for ZK58084: 0
2026-03-29 07:01:40 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-29 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-29 07:01:40 [auto1.nl] INFO: Scrape type for ZN70459: 0
2026-03-29 07:01:40 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-29 07:01:40 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-29 07:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:41 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 643 | hits on page: 40
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for FE67699: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for XU82529: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for VZ65695: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for GU70185: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for GD33520: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for PS01910: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for AB54003: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for HD36341: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for JA81822: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for JA39510: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for AD33035: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for NJ31093: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for YZ13462: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for LE06198: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for HW32084: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for EW29368: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for UW56966: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for YF94322: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for PK76759: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for GA63942: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for XH80509: 0
2026-03-29 07:01:41 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-29 07:01:41 [auto1.nl] INFO: Scrape type for ND88147: 0
2026-03-29 07:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:42 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 643 | hits on page: 40
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-29 07:01:42 [auto1.nl] INFO: Scrape type for WE18316: 0
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-29 07:01:42 [auto1.nl] INFO: Scrape type for SS74343: 0
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-29 07:01:42 [auto1.nl] INFO: Scrape type for YZ60467: 0
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-29 07:01:42 [auto1.nl] INFO: Scrape type for MZ09465: 0
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-29 07:01:42 [auto1.nl] INFO: Scrape type for EG04578: 0
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-29 07:01:42 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-29 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for PJ49676: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for TL29950: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for GZ48867: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for ZB71006: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for DU11939: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for KK51574: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for AK27162: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for KX15971: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for MV10901: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for ZT51900: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for GN27243: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for NU66962: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for VY08351: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-29 07:01:43 [auto1.nl] INFO: Scrape type for XR71865: 0
2026-03-29 07:01:43 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-29 07:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:44 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 643 | hits on page: 40
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for YA06880: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for SE60245: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for KL38892: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for TW61693: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for SE95402: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for RK78214: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for EW45242: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for UA80107: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for UH76205: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for KX92525: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for UU92994: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for WY17438: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for ZS54708: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for BB32456: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for WW25859: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for BP52845: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for DX51815: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for NJ12224: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-29 07:01:44 [auto1.nl] INFO: Scrape type for DJ46393: 0
2026-03-29 07:01:44 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-29 07:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:45 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 643 | hits on page: 40
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for JF84007: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for KD48941: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for WN94746: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for EU38085: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for WU56616: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for CT48510: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for RD76922: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for WC26387: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for LF00808: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for JM92964: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for HJ37238: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-29 07:01:45 [auto1.nl] INFO: Scrape type for JK34334: 0
2026-03-29 07:01:45 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-29 07:01:46 [auto1.nl] INFO: Scrape type for YB88576: 0
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-29 07:01:46 [auto1.nl] INFO: Scrape type for YG37971: 0
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-29 07:01:46 [auto1.nl] INFO: Scrape type for UF88780: 0
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-29 07:01:46 [auto1.nl] INFO: Scrape type for KC88699: 0
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-29 07:01:46 [auto1.nl] INFO: Scrape type for WZ79997: 0
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-29 07:01:46 [auto1.nl] INFO: Scrape type for MP39959: 0
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-29 07:01:46 [auto1.nl] INFO: Scrape type for YN95467: 0
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-29 07:01:46 [auto1.nl] INFO: Scrape type for AW17903: 0
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-29 07:01:46 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-29 07:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:48 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 643 | hits on page: 3
2026-03-29 07:01:48 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-29 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-29 07:01:48 [auto1.nl] INFO: Scrape type for NC22018: 0
2026-03-29 07:01:48 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-29 07:01:48 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-29 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-29 07:01:48 [auto1.nl] INFO: Scrape type for ZG49112: 0
2026-03-29 07:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 07:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 07:01:48 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 643 | hits on page: 0
2026-03-29 07:01:49 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 07:01:49 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-29 07:01:49 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 165, <ScrapeType.BATCH_SKIPPED: 5>: 158}
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774335709 HTTP/1.1" 200 None
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AE29260') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AJ14031') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BB19078') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CG20876') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH05506') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EL70169') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM54689') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ES54442') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FU65942') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GX17086') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HE43668') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HJ64303') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM80124') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF61355') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MK81921') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PF20917') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PP87825') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE95062') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TM07088') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY46153') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK15837') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WR65969') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS78452') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WV64164') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY01430') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG94875') HTTP/1.1" 204 0
2026-03-29 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZJ02157') HTTP/1.1" 204 0
2026-03-29 07:01:50 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (20 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-29T07_00_00.jl
2026-03-29 07:01:50 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 58118,
 'downloader/request_count': 22,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 20,
 'downloader/response_bytes': 2974973,
 'downloader/response_count': 22,
 'downloader/response_status_count/200': 22,
 'elapsed_time_seconds': 102.794401,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 7, 1, 49, 996399, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 20,
 'log_count/DEBUG': 931,
 'log_count/INFO': 1257,
 'memusage/max': 164311040,
 'memusage/startup': 149643264,
 'request_depth_max': 21,
 'response_received_count': 22,
 'scheduler/dequeued': 22,
 'scheduler/dequeued/memory': 22,
 'scheduler/enqueued': 22,
 'scheduler/enqueued/memory': 22,
 'scrape_type/batch_skipped': 340,
 'scrape_type/price_update': 20,
 'scrape_type/skipped': 323,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 22,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.6313745293300603,
 'scrapy-zyte-api/mean_response_seconds': 3.7546374323904854,
 'scrapy-zyte-api/processed': 22,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 22,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 21,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 22,
 'scrapy-zyte-api/request_args/httpRequestBody': 20,
 'scrapy-zyte-api/request_args/httpRequestMethod': 20,
 'scrapy-zyte-api/request_args/httpResponseBody': 22,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 22,
 'scrapy-zyte-api/request_args/sessionContext': 22,
 'scrapy-zyte-api/request_args/url': 22,
 'scrapy-zyte-api/status_codes/200': 22,
 'scrapy-zyte-api/success': 22,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 683,
 'source/total_available': 643,
 'start_time': datetime.datetime(2026, 3, 29, 7, 0, 7, 201998, tzinfo=datetime.timezone.utc)}
2026-03-29 07:01:50 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 07:01:50 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fd45ba96490>
2026-03-29 07:01:50 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fd45ba96bd0>