2026-03-28 05:10:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 05:10:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 05:10:06 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-28 05:10:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-28 05:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 05:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 05:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 05:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 05:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: 4e0565e8ba8dc0a8
2026-03-28 05:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 05:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-28T05_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 05:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 05:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 05:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 05:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 05:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 05:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 05:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 05:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-28 05:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 05:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 05:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 05:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 05:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 05:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 05:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 05:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 05:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 05:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 05:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 05:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 05:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 05:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 05:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 05:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 05:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 05:10:16 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 917 | hits on page: 40
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET91545%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for ET91545: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC45761%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for VC45761: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for RJ64387: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG19961%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for PG19961: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for YW05960: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for VX32369: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for YP02517: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH14183%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for EH14183: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ01481%27 HTTP/1.1" 200 None
2026-03-28 05:10:16 [auto1.nl] INFO: Scrape type for PZ01481: 0
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 05:10:16 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 05:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:10:17 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 917 | hits on page: 40
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET91545%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for ET91545: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC45761%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for VC45761: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for RJ64387: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG19961%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for PG19961: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for YW05960: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for VX32369: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for YP02517: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH14183%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for EH14183: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ01481%27 HTTP/1.1" 200 None
2026-03-28 05:10:17 [auto1.nl] INFO: Scrape type for PZ01481: 0
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 05:10:17 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 05:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:10:19 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 917 | hits on page: 40
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF40574%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for RF40574: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for AA80905: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for WF02577: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for TU99712: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for RA23366: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for UB80121: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for LG71332: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for JM47469: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for BX66014: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for ME20407: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for SR40415: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for MZ48021: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for VH01672: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for FH34143: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for YP25238: 0
2026-03-28 05:10:19 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS95271%27 HTTP/1.1" 200 None
2026-03-28 05:10:19 [auto1.nl] INFO: Scrape type for HS95271: 2
2026-03-28 05:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b92e5b4-b6fb-5663-9736-7e435e46fe2c with identifier: HS95271
2026-03-28 05:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b92e5b4-b6fb-5663-9736-7e435e46fe2c with scrape type 2
2026-03-28 05:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b92e5b4-b6fb-5663-9736-7e435e46fe2c with scrape type 2
2026-03-28 05:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b92e5b4-b6fb-5663-9736-7e435e46fe2c, identifier: HS95271
2026-03-28 05:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b92e5b4-b6fb-5663-9736-7e435e46fe2c with identifier: HS95271
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 05:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 05:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b92e5b4-b6fb-5663-9736-7e435e46fe2c with identifier: HS95271
2026-03-28 05:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b92e5b4-b6fb-5663-9736-7e435e46fe2c with identifier: HS95271 to the API
2026-03-28 05:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'diesel',
 'id': '5b92e5b4-b6fb-5663-9736-7e435e46fe2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS95271',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 California',
 'odometer': 295691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-21',
 'seller_name': None,
 'title': 'Volkswagen T5 California 2.5 TDI Comfortline Aufstelldach',
 'transmission': 'manual',
 'trim': 'Comfortline Aufstelldach',
 'year': 2005}
2026-03-28 05:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS95271%27 HTTP/1.1" 200 None
2026-03-28 05:10:38 [auto1.nl] INFO: Saving data for HS95271: {'auction_closing_time': 1774716349.0, 'created_time': 1774354446.848902, 'last_price_update_time': 1774674638.92004}
2026-03-28 05:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HS95271') HTTP/1.1" 204 0
2026-03-28 05:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ78328%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for PJ78328: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW65068%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for MW65068: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB97698%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for KB97698: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for UC91516: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU39943%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for LU39943: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV76653%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for CV76653: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ60443%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for CZ60443: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54016%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for AB54016: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for FJ00169: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WT58034%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for WT58034: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM03723%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for YM03723: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR64287%27 HTTP/1.1" 200 None
2026-03-28 05:10:39 [auto1.nl] INFO: Scrape type for TR64287: 0
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-28 05:10:39 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-28 05:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:10:40 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 917 | hits on page: 40
2026-03-28 05:10:40 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE34975%27 HTTP/1.1" 200 None
2026-03-28 05:10:40 [auto1.nl] INFO: Scrape type for LE34975: 0
2026-03-28 05:10:40 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-28 05:10:40 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK53895%27 HTTP/1.1" 200 None
2026-03-28 05:10:40 [auto1.nl] INFO: Scrape type for FK53895: 2
2026-03-28 05:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2413c869-29bc-58f2-a12d-d50b871fc188 with identifier: FK53895
2026-03-28 05:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2413c869-29bc-58f2-a12d-d50b871fc188 with scrape type 2
2026-03-28 05:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2413c869-29bc-58f2-a12d-d50b871fc188 with scrape type 2
2026-03-28 05:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2413c869-29bc-58f2-a12d-d50b871fc188, identifier: FK53895
2026-03-28 05:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2413c869-29bc-58f2-a12d-d50b871fc188 with identifier: FK53895
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 05:10:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 05:10:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2413c869-29bc-58f2-a12d-d50b871fc188 with identifier: FK53895
2026-03-28 05:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2413c869-29bc-58f2-a12d-d50b871fc188 with identifier: FK53895 to the API
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:05:14Z',
 'fuel_type': 'petrol',
 'id': '2413c869-29bc-58f2-a12d-d50b871fc188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK53895',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 126574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-19',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300 4Drive',
 'transmission': 'automatic',
 'trim': 'Cupra 300 4Drive',
 'year': 2018}
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK53895%27 HTTP/1.1" 200 None
2026-03-28 05:10:40 [auto1.nl] INFO: Saving data for FK53895: {'auction_closing_time': 1774713914.0, 'created_time': 1774552255.882488, 'last_price_update_time': 1774674640.943698}
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK53895') HTTP/1.1" 204 0
2026-03-28 05:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX13279%27 HTTP/1.1" 200 None
2026-03-28 05:10:41 [auto1.nl] INFO: Scrape type for JX13279: 0
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT56594%27 HTTP/1.1" 200 None
2026-03-28 05:10:41 [auto1.nl] INFO: Scrape type for NT56594: 0
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-28 05:10:41 [auto1.nl] INFO: Scrape type for XG57923: 2
2026-03-28 05:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c517fe9b-161c-538b-8fbc-45fcd2968086 with identifier: XG57923
2026-03-28 05:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c517fe9b-161c-538b-8fbc-45fcd2968086 with scrape type 2
2026-03-28 05:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c517fe9b-161c-538b-8fbc-45fcd2968086 with scrape type 2
2026-03-28 05:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c517fe9b-161c-538b-8fbc-45fcd2968086, identifier: XG57923
2026-03-28 05:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c517fe9b-161c-538b-8fbc-45fcd2968086 with identifier: XG57923
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 05:10:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c517fe9b-161c-538b-8fbc-45fcd2968086 with identifier: XG57923
2026-03-28 05:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c517fe9b-161c-538b-8fbc-45fcd2968086 with identifier: XG57923 to the API
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:50Z',
 'fuel_type': 'petrol',
 'id': 'c517fe9b-161c-538b-8fbc-45fcd2968086',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG57923',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 313070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Volvo V40 2.0 T4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2018}
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-28 05:10:41 [auto1.nl] INFO: Saving data for XG57923: {'auction_closing_time': 1774715630.0, 'created_time': 1774552260.008821, 'last_price_update_time': 1774674641.616876}
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XG57923') HTTP/1.1" 204 0
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-28 05:10:41 [auto1.nl] INFO: Scrape type for FU47491: 0
2026-03-28 05:10:41 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL54745%27 HTTP/1.1" 200 None
2026-03-28 05:10:41 [auto1.nl] INFO: Scrape type for NL54745: 2
2026-03-28 05:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf46f60f-b2c3-5d17-a676-fbbe069b4f6a with identifier: NL54745
2026-03-28 05:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf46f60f-b2c3-5d17-a676-fbbe069b4f6a with scrape type 2
2026-03-28 05:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf46f60f-b2c3-5d17-a676-fbbe069b4f6a with scrape type 2
2026-03-28 05:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bf46f60f-b2c3-5d17-a676-fbbe069b4f6a, identifier: NL54745
2026-03-28 05:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bf46f60f-b2c3-5d17-a676-fbbe069b4f6a with identifier: NL54745
2026-03-28 05:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bf46f60f-b2c3-5d17-a676-fbbe069b4f6a with identifier: NL54745
2026-03-28 05:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bf46f60f-b2c3-5d17-a676-fbbe069b4f6a with identifier: NL54745 to the API
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:17:49Z',
 'fuel_type': 'petrol',
 'id': 'bf46f60f-b2c3-5d17-a676-fbbe069b4f6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL54745',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 64771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-02',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2011}
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL54745%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Saving data for NL54745: {'auction_closing_time': 1774714669.0, 'created_time': 1774465923.873524, 'last_price_update_time': 1774674642.059865}
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL54745') HTTP/1.1" 204 0
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS22669%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Scrape type for AS22669: 0
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Scrape type for BM26306: 0
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: ZM76247
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Scrape type for MM08239: 2
2026-03-28 05:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa9c878c-1789-594d-82e6-fde7ff729c19 with identifier: MM08239
2026-03-28 05:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa9c878c-1789-594d-82e6-fde7ff729c19 with scrape type 2
2026-03-28 05:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa9c878c-1789-594d-82e6-fde7ff729c19 with scrape type 2
2026-03-28 05:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aa9c878c-1789-594d-82e6-fde7ff729c19, identifier: MM08239
2026-03-28 05:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aa9c878c-1789-594d-82e6-fde7ff729c19 with identifier: MM08239
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 05:10:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aa9c878c-1789-594d-82e6-fde7ff729c19 with identifier: MM08239
2026-03-28 05:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aa9c878c-1789-594d-82e6-fde7ff729c19 with identifier: MM08239 to the API
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:53:01Z',
 'fuel_type': 'petrol',
 'id': 'aa9c878c-1789-594d-82e6-fde7ff729c19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM08239',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 134869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-04',
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2004}
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Saving data for MM08239: {'auction_closing_time': 1774716781.0, 'created_time': 1774552317.733776, 'last_price_update_time': 1774674642.776872}
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MM08239') HTTP/1.1" 204 0
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS94001%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Scrape type for HS94001: 0
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL56682%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Scrape type for BL56682: 0
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB63862%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Scrape type for MB63862: 0
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Scrape type for SE84312: 0
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-28 05:10:42 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE73396%27 HTTP/1.1" 200 None
2026-03-28 05:10:42 [auto1.nl] INFO: Scrape type for PE73396: 2
2026-03-28 05:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3ee4e1a-3bd2-5879-b18d-ea553afeb8cb with identifier: PE73396
2026-03-28 05:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ee4e1a-3bd2-5879-b18d-ea553afeb8cb with scrape type 2
2026-03-28 05:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3ee4e1a-3bd2-5879-b18d-ea553afeb8cb with scrape type 2
2026-03-28 05:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c3ee4e1a-3bd2-5879-b18d-ea553afeb8cb, identifier: PE73396
2026-03-28 05:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c3ee4e1a-3bd2-5879-b18d-ea553afeb8cb with identifier: PE73396
2026-03-28 05:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c3ee4e1a-3bd2-5879-b18d-ea553afeb8cb with identifier: PE73396
2026-03-28 05:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c3ee4e1a-3bd2-5879-b18d-ea553afeb8cb with identifier: PE73396 to the API
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:31:54Z',
 'fuel_type': 'diesel',
 'id': 'c3ee4e1a-3bd2-5879-b18d-ea553afeb8cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE73396',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 234845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-08',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Ambiente',
 'transmission': 'automatic',
 'trim': 'quattro Ambiente',
 'year': 2013}
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE73396%27 HTTP/1.1" 200 None
2026-03-28 05:10:43 [auto1.nl] INFO: Saving data for PE73396: {'auction_closing_time': 1774715514.0, 'created_time': 1774465991.329869, 'last_price_update_time': 1774674643.310639}
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PE73396') HTTP/1.1" 204 0
2026-03-28 05:10:43 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY41827%27 HTTP/1.1" 200 None
2026-03-28 05:10:43 [auto1.nl] INFO: Scrape type for CY41827: 0
2026-03-28 05:10:43 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-28 05:10:43 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-28 05:10:43 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG22704%27 HTTP/1.1" 200 None
2026-03-28 05:10:43 [auto1.nl] INFO: Scrape type for ZG22704: 0
2026-03-28 05:10:43 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS09006%27 HTTP/1.1" 200 None
2026-03-28 05:10:43 [auto1.nl] INFO: Scrape type for PS09006: 0
2026-03-28 05:10:43 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-28 05:10:43 [auto1.nl] INFO: Scrape type for KB59261: 0
2026-03-28 05:10:43 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF97973%27 HTTP/1.1" 200 None
2026-03-28 05:10:43 [auto1.nl] INFO: Scrape type for PF97973: 2
2026-03-28 05:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b48f4326-c7f9-5e6d-a22c-f3d6ef4ca4e1 with identifier: PF97973
2026-03-28 05:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b48f4326-c7f9-5e6d-a22c-f3d6ef4ca4e1 with scrape type 2
2026-03-28 05:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b48f4326-c7f9-5e6d-a22c-f3d6ef4ca4e1 with scrape type 2
2026-03-28 05:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b48f4326-c7f9-5e6d-a22c-f3d6ef4ca4e1, identifier: PF97973
2026-03-28 05:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b48f4326-c7f9-5e6d-a22c-f3d6ef4ca4e1 with identifier: PF97973
2026-03-28 05:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b48f4326-c7f9-5e6d-a22c-f3d6ef4ca4e1 with identifier: PF97973
2026-03-28 05:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b48f4326-c7f9-5e6d-a22c-f3d6ef4ca4e1 with identifier: PF97973 to the API
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:06:51Z',
 'fuel_type': 'diesel',
 'id': 'b48f4326-c7f9-5e6d-a22c-f3d6ef4ca4e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF97973',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 176591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-11',
 'seller_name': None,
 'title': 'Ford Transit 1.8 TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2012}
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF97973%27 HTTP/1.1" 200 None
2026-03-28 05:10:43 [auto1.nl] INFO: Saving data for PF97973: {'auction_closing_time': 1774714011.0, 'created_time': 1774465993.887823, 'last_price_update_time': 1774674643.915533}
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PF97973') HTTP/1.1" 204 0
2026-03-28 05:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:10:44 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 917 | hits on page: 40
2026-03-28 05:10:44 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-28 05:10:44 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-28 05:10:44 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-28 05:10:44 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-28 05:10:44 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-28 05:10:44 [auto1.nl] INFO: Scrape type for ZR90330: 2
2026-03-28 05:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with identifier: ZR90330
2026-03-28 05:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with scrape type 2
2026-03-28 05:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with scrape type 2
2026-03-28 05:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378, identifier: ZR90330
2026-03-28 05:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with identifier: ZR90330
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 05:10:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 05:10:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with identifier: ZR90330
2026-03-28 05:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with identifier: ZR90330 to the API
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:58:38Z',
 'fuel_type': 'hybrid',
 'id': '818d5adf-ab9d-587a-b7ec-a2bf8ff27378',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR90330',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 32788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-04',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4 Classic Trim',
 'transmission': 'automatic',
 'trim': 'ALL4 Classic Trim',
 'year': 2022}
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-28 05:10:44 [auto1.nl] INFO: Saving data for ZR90330: {'auction_closing_time': 1774717118.0, 'created_time': 1774552359.521955, 'last_price_update_time': 1774674644.959593}
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR90330') HTTP/1.1" 204 0
2026-03-28 05:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG43162%27 HTTP/1.1" 200 None
2026-03-28 05:10:45 [auto1.nl] INFO: Scrape type for YG43162: 0
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY36712%27 HTTP/1.1" 200 None
2026-03-28 05:10:45 [auto1.nl] INFO: Scrape type for MY36712: 0
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT43342%27 HTTP/1.1" 200 None
2026-03-28 05:10:45 [auto1.nl] INFO: Scrape type for DT43342: 2
2026-03-28 05:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e182b7d9-3d94-516d-a538-24b64cdfb5f0 with identifier: DT43342
2026-03-28 05:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e182b7d9-3d94-516d-a538-24b64cdfb5f0 with scrape type 2
2026-03-28 05:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e182b7d9-3d94-516d-a538-24b64cdfb5f0 with scrape type 2
2026-03-28 05:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e182b7d9-3d94-516d-a538-24b64cdfb5f0, identifier: DT43342
2026-03-28 05:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e182b7d9-3d94-516d-a538-24b64cdfb5f0 with identifier: DT43342
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 05:10:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e182b7d9-3d94-516d-a538-24b64cdfb5f0 with identifier: DT43342
2026-03-28 05:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e182b7d9-3d94-516d-a538-24b64cdfb5f0 with identifier: DT43342 to the API
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:50Z',
 'fuel_type': 'electro',
 'id': 'e182b7d9-3d94-516d-a538-24b64cdfb5f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT43342',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Leaf',
 'odometer': 109741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-12',
 'seller_name': None,
 'title': 'Nissan Leaf electric drive 110 kW Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2020}
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT43342%27 HTTP/1.1" 200 None
2026-03-28 05:10:45 [auto1.nl] INFO: Saving data for DT43342: {'auction_closing_time': 1774715390.0, 'created_time': 1774552350.751561, 'last_price_update_time': 1774674645.630923}
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DT43342') HTTP/1.1" 204 0
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW63639%27 HTTP/1.1" 200 None
2026-03-28 05:10:45 [auto1.nl] INFO: Scrape type for XW63639: 0
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK25507%27 HTTP/1.1" 200 None
2026-03-28 05:10:45 [auto1.nl] INFO: Scrape type for MK25507: 0
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-28 05:10:45 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT18322%27 HTTP/1.1" 200 None
2026-03-28 05:10:45 [auto1.nl] INFO: Scrape type for KT18322: 2
2026-03-28 05:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62abd7e9-be11-51ec-ae7c-f87f0413f91a with identifier: KT18322
2026-03-28 05:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62abd7e9-be11-51ec-ae7c-f87f0413f91a with scrape type 2
2026-03-28 05:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62abd7e9-be11-51ec-ae7c-f87f0413f91a with scrape type 2
2026-03-28 05:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 62abd7e9-be11-51ec-ae7c-f87f0413f91a, identifier: KT18322
2026-03-28 05:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 62abd7e9-be11-51ec-ae7c-f87f0413f91a with identifier: KT18322
2026-03-28 05:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 62abd7e9-be11-51ec-ae7c-f87f0413f91a with identifier: KT18322
2026-03-28 05:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 62abd7e9-be11-51ec-ae7c-f87f0413f91a with identifier: KT18322 to the API
2026-03-28 05:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-28T16:37:58Z',
 'fuel_type': 'electro',
 'id': '62abd7e9-be11-51ec-ae7c-f87f0413f91a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT18322',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'EQC',
 'odometer': 130613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': 'Mercedes-Benz EQC electric drive 300 kW 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT18322%27 HTTP/1.1" 200 None
2026-03-28 05:10:46 [auto1.nl] INFO: Saving data for KT18322: {'auction_closing_time': 1774715878.0, 'created_time': 1773688524.039443, 'last_price_update_time': 1774674646.194783}
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KT18322') HTTP/1.1" 204 0
2026-03-28 05:10:46 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-28 05:10:46 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-28 05:10:46 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16632%27 HTTP/1.1" 200 None
2026-03-28 05:10:46 [auto1.nl] INFO: Scrape type for LZ16632: 2
2026-03-28 05:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1bc2700-d7d0-5518-92c1-e94b99db3084 with identifier: LZ16632
2026-03-28 05:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bc2700-d7d0-5518-92c1-e94b99db3084 with scrape type 2
2026-03-28 05:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1bc2700-d7d0-5518-92c1-e94b99db3084 with scrape type 2
2026-03-28 05:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1bc2700-d7d0-5518-92c1-e94b99db3084, identifier: LZ16632
2026-03-28 05:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1bc2700-d7d0-5518-92c1-e94b99db3084 with identifier: LZ16632
2026-03-28 05:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1bc2700-d7d0-5518-92c1-e94b99db3084 with identifier: LZ16632
2026-03-28 05:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1bc2700-d7d0-5518-92c1-e94b99db3084 with identifier: LZ16632 to the API
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:18:32Z',
 'fuel_type': 'electro',
 'id': 'a1bc2700-d7d0-5518-92c1-e94b99db3084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ16632',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 102966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seller_name': None,
 'title': 'Audi e-tron 50 quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2020}
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16632%27 HTTP/1.1" 200 None
2026-03-28 05:10:46 [auto1.nl] INFO: Saving data for LZ16632: {'auction_closing_time': 1774714712.0, 'created_time': 1774552238.700693, 'last_price_update_time': 1774674646.707851}
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LZ16632') HTTP/1.1" 204 0
2026-03-28 05:10:46 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-28 05:10:46 [auto1.nl] INFO: Scrape type for ML63258: 2
2026-03-28 05:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7922be91-5894-593d-9c3d-79be9439238a with identifier: ML63258
2026-03-28 05:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7922be91-5894-593d-9c3d-79be9439238a with scrape type 2
2026-03-28 05:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7922be91-5894-593d-9c3d-79be9439238a with scrape type 2
2026-03-28 05:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7922be91-5894-593d-9c3d-79be9439238a, identifier: ML63258
2026-03-28 05:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7922be91-5894-593d-9c3d-79be9439238a with identifier: ML63258
2026-03-28 05:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7922be91-5894-593d-9c3d-79be9439238a with identifier: ML63258
2026-03-28 05:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7922be91-5894-593d-9c3d-79be9439238a with identifier: ML63258 to the API
2026-03-28 05:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:46:10Z',
 'fuel_type': 'petrol',
 'id': '7922be91-5894-593d-9c3d-79be9439238a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML63258',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 167714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-28 05:10:47 [auto1.nl] INFO: Saving data for ML63258: {'auction_closing_time': 1774716370.0, 'created_time': 1774552317.086741, 'last_price_update_time': 1774674647.185841}
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML63258') HTTP/1.1" 204 0
2026-03-28 05:10:47 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-28 05:10:47 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-28 05:10:47 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66252%27 HTTP/1.1" 200 None
2026-03-28 05:10:47 [auto1.nl] INFO: Scrape type for GY66252: 0
2026-03-28 05:10:47 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD70514%27 HTTP/1.1" 200 None
2026-03-28 05:10:47 [auto1.nl] INFO: Scrape type for UD70514: 0
2026-03-28 05:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:10:48 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 917 | hits on page: 40
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-28 05:10:48 [auto1.nl] INFO: Scrape type for DS36560: 2
2026-03-28 05:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with identifier: DS36560
2026-03-28 05:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with scrape type 2
2026-03-28 05:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with scrape type 2
2026-03-28 05:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2a13e86-b14b-5aeb-8cd0-8458f8db4289, identifier: DS36560
2026-03-28 05:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with identifier: DS36560
2026-03-28 05:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with identifier: DS36560
2026-03-28 05:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with identifier: DS36560 to the API
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-28T16:49:09Z',
 'fuel_type': 'petrol',
 'id': 'd2a13e86-b14b-5aeb-8cd0-8458f8db4289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS36560',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 206188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-19',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2014}
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-28 05:10:48 [auto1.nl] INFO: Saving data for DS36560: {'auction_closing_time': 1774716549.0, 'created_time': 1774552246.52262, 'last_price_update_time': 1774674648.845745}
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DS36560') HTTP/1.1" 204 0
2026-03-28 05:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-28 05:10:48 [auto1.nl] INFO: Scrape type for SM80467: 0
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-28 05:10:48 [auto1.nl] INFO: Scrape type for EW85240: 0
2026-03-28 05:10:48 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-28 05:10:49 [auto1.nl] INFO: Scrape type for GY89787: 0
2026-03-28 05:10:49 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX12849%27 HTTP/1.1" 200 None
2026-03-28 05:10:49 [auto1.nl] INFO: Scrape type for EX12849: 0
2026-03-28 05:10:49 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-28 05:10:49 [auto1.nl] INFO: Scrape type for CH10226: 2
2026-03-28 05:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19aaf720-730f-5f6f-a418-0f20033e49fe with identifier: CH10226
2026-03-28 05:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19aaf720-730f-5f6f-a418-0f20033e49fe with scrape type 2
2026-03-28 05:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19aaf720-730f-5f6f-a418-0f20033e49fe with scrape type 2
2026-03-28 05:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 19aaf720-730f-5f6f-a418-0f20033e49fe, identifier: CH10226
2026-03-28 05:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 19aaf720-730f-5f6f-a418-0f20033e49fe with identifier: CH10226
2026-03-28 05:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 19aaf720-730f-5f6f-a418-0f20033e49fe with identifier: CH10226
2026-03-28 05:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 19aaf720-730f-5f6f-a418-0f20033e49fe with identifier: CH10226 to the API
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:24:45Z',
 'fuel_type': 'petrol',
 'id': '19aaf720-730f-5f6f-a418-0f20033e49fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH10226',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 188328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-28 05:10:49 [auto1.nl] INFO: Saving data for CH10226: {'auction_closing_time': 1774715085.0, 'created_time': 1774552320.682249, 'last_price_update_time': 1774674649.465372}
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CH10226') HTTP/1.1" 204 0
2026-03-28 05:10:49 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-28 05:10:49 [auto1.nl] INFO: Scrape type for VL07732: 0
2026-03-28 05:10:49 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-28 05:10:49 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-28 05:10:49 [auto1.nl] INFO: Scrape type for ZR54060: 2
2026-03-28 05:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a584e887-18b9-5c45-931c-298ae77cc50a with identifier: ZR54060
2026-03-28 05:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a584e887-18b9-5c45-931c-298ae77cc50a with scrape type 2
2026-03-28 05:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a584e887-18b9-5c45-931c-298ae77cc50a with scrape type 2
2026-03-28 05:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a584e887-18b9-5c45-931c-298ae77cc50a, identifier: ZR54060
2026-03-28 05:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a584e887-18b9-5c45-931c-298ae77cc50a with identifier: ZR54060
2026-03-28 05:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a584e887-18b9-5c45-931c-298ae77cc50a with identifier: ZR54060
2026-03-28 05:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a584e887-18b9-5c45-931c-298ae77cc50a with identifier: ZR54060 to the API
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:05:34Z',
 'fuel_type': 'petrol',
 'id': 'a584e887-18b9-5c45-931c-298ae77cc50a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR54060',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 296696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-09',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2011}
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-28 05:10:49 [auto1.nl] INFO: Saving data for ZR54060: {'auction_closing_time': 1774713934.0, 'created_time': 1774552325.628811, 'last_price_update_time': 1774674649.941938}
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR54060') HTTP/1.1" 204 0
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH30413%27 HTTP/1.1" 200 None
2026-03-28 05:10:50 [auto1.nl] INFO: Scrape type for TH30413: 0
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LB35433%27 HTTP/1.1" 200 None
2026-03-28 05:10:50 [auto1.nl] INFO: Scrape type for LB35433: 0
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV30454%27 HTTP/1.1" 200 None
2026-03-28 05:10:50 [auto1.nl] INFO: Scrape type for EV30454: 2
2026-03-28 05:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c643bd-8ad9-5a4b-9995-07a166d10afb with identifier: EV30454
2026-03-28 05:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c643bd-8ad9-5a4b-9995-07a166d10afb with scrape type 2
2026-03-28 05:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9c643bd-8ad9-5a4b-9995-07a166d10afb with scrape type 2
2026-03-28 05:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c9c643bd-8ad9-5a4b-9995-07a166d10afb, identifier: EV30454
2026-03-28 05:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c9c643bd-8ad9-5a4b-9995-07a166d10afb with identifier: EV30454
2026-03-28 05:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c9c643bd-8ad9-5a4b-9995-07a166d10afb with identifier: EV30454
2026-03-28 05:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c9c643bd-8ad9-5a4b-9995-07a166d10afb with identifier: EV30454 to the API
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:31:24Z',
 'fuel_type': 'petrol',
 'id': 'c9c643bd-8ad9-5a4b-9995-07a166d10afb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV30454',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 168376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-17',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV30454%27 HTTP/1.1" 200 None
2026-03-28 05:10:50 [auto1.nl] INFO: Saving data for EV30454: {'auction_closing_time': 1774715484.0, 'created_time': 1774465892.835264, 'last_price_update_time': 1774674650.486553}
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EV30454') HTTP/1.1" 204 0
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW15981%27 HTTP/1.1" 200 None
2026-03-28 05:10:50 [auto1.nl] INFO: Scrape type for AW15981: 2
2026-03-28 05:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c11c088f-4dac-5ee8-9957-a758caa83bca with identifier: AW15981
2026-03-28 05:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c11c088f-4dac-5ee8-9957-a758caa83bca with scrape type 2
2026-03-28 05:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c11c088f-4dac-5ee8-9957-a758caa83bca with scrape type 2
2026-03-28 05:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c11c088f-4dac-5ee8-9957-a758caa83bca, identifier: AW15981
2026-03-28 05:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c11c088f-4dac-5ee8-9957-a758caa83bca with identifier: AW15981
2026-03-28 05:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c11c088f-4dac-5ee8-9957-a758caa83bca with identifier: AW15981
2026-03-28 05:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c11c088f-4dac-5ee8-9957-a758caa83bca with identifier: AW15981 to the API
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:14:38Z',
 'fuel_type': 'hybrid',
 'id': 'c11c088f-4dac-5ee8-9957-a758caa83bca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW15981',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 323713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-26',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Intense 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Intense 4WD',
 'year': 2013}
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW15981%27 HTTP/1.1" 200 None
2026-03-28 05:10:50 [auto1.nl] INFO: Saving data for AW15981: {'auction_closing_time': 1774714478.0, 'created_time': 1774465871.225708, 'last_price_update_time': 1774674650.941783}
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW15981') HTTP/1.1" 204 0
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-28 05:10:50 [auto1.nl] INFO: Scrape type for DW43709: 0
2026-03-28 05:10:50 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM68781%27 HTTP/1.1" 200 None
2026-03-28 05:10:50 [auto1.nl] INFO: Scrape type for AM68781: 2
2026-03-28 05:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 901aa58c-cd73-5f1a-98b2-f0959621bf7f with identifier: AM68781
2026-03-28 05:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901aa58c-cd73-5f1a-98b2-f0959621bf7f with scrape type 2
2026-03-28 05:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 901aa58c-cd73-5f1a-98b2-f0959621bf7f with scrape type 2
2026-03-28 05:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 901aa58c-cd73-5f1a-98b2-f0959621bf7f, identifier: AM68781
2026-03-28 05:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 901aa58c-cd73-5f1a-98b2-f0959621bf7f with identifier: AM68781
2026-03-28 05:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 901aa58c-cd73-5f1a-98b2-f0959621bf7f with identifier: AM68781
2026-03-28 05:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 901aa58c-cd73-5f1a-98b2-f0959621bf7f with identifier: AM68781 to the API
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:52:32Z',
 'fuel_type': 'petrol',
 'id': '901aa58c-cd73-5f1a-98b2-f0959621bf7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM68781',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 71623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2020}
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM68781%27 HTTP/1.1" 200 None
2026-03-28 05:10:51 [auto1.nl] INFO: Saving data for AM68781: {'auction_closing_time': 1774716752.0, 'created_time': 1773134014.434855, 'last_price_update_time': 1774674651.392412}
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AM68781') HTTP/1.1" 204 0
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU55364%27 HTTP/1.1" 200 None
2026-03-28 05:10:51 [auto1.nl] INFO: Scrape type for MU55364: 0
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV96248%27 HTTP/1.1" 200 None
2026-03-28 05:10:51 [auto1.nl] INFO: Scrape type for PV96248: 2
2026-03-28 05:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16260cdf-fece-58b1-83d1-4e4377451280 with identifier: PV96248
2026-03-28 05:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16260cdf-fece-58b1-83d1-4e4377451280 with scrape type 2
2026-03-28 05:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16260cdf-fece-58b1-83d1-4e4377451280 with scrape type 2
2026-03-28 05:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 16260cdf-fece-58b1-83d1-4e4377451280, identifier: PV96248
2026-03-28 05:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 16260cdf-fece-58b1-83d1-4e4377451280 with identifier: PV96248
2026-03-28 05:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 16260cdf-fece-58b1-83d1-4e4377451280 with identifier: PV96248
2026-03-28 05:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 16260cdf-fece-58b1-83d1-4e4377451280 with identifier: PV96248 to the API
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:07Z',
 'fuel_type': 'petrol',
 'id': '16260cdf-fece-58b1-83d1-4e4377451280',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV96248',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 95188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2016}
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV96248%27 HTTP/1.1" 200 None
2026-03-28 05:10:51 [auto1.nl] INFO: Saving data for PV96248: {'auction_closing_time': 1774716907.0, 'created_time': 1774465851.907542, 'last_price_update_time': 1774674651.879736}
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PV96248') HTTP/1.1" 204 0
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-28 05:10:51 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-28 05:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-28 05:10:52 [auto1.nl] INFO: Scrape type for BC50110: 2
2026-03-28 05:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b9489c-3e78-54b4-9fe1-9971457f18d8 with identifier: BC50110
2026-03-28 05:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b9489c-3e78-54b4-9fe1-9971457f18d8 with scrape type 2
2026-03-28 05:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82b9489c-3e78-54b4-9fe1-9971457f18d8 with scrape type 2
2026-03-28 05:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 82b9489c-3e78-54b4-9fe1-9971457f18d8, identifier: BC50110
2026-03-28 05:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 82b9489c-3e78-54b4-9fe1-9971457f18d8 with identifier: BC50110
2026-03-28 05:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 82b9489c-3e78-54b4-9fe1-9971457f18d8 with identifier: BC50110
2026-03-28 05:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 82b9489c-3e78-54b4-9fe1-9971457f18d8 with identifier: BC50110 to the API
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:00:01Z',
 'fuel_type': 'petrol',
 'id': '82b9489c-3e78-54b4-9fe1-9971457f18d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC50110',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 199083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-11',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-28 05:10:52 [auto1.nl] INFO: Saving data for BC50110: {'auction_closing_time': 1774713601.0, 'created_time': 1774552347.355896, 'last_price_update_time': 1774674652.397777}
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC50110') HTTP/1.1" 204 0
2026-03-28 05:10:52 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-28 05:10:52 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-28 05:10:52 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV45583%27 HTTP/1.1" 200 None
2026-03-28 05:10:52 [auto1.nl] INFO: Scrape type for VV45583: 0
2026-03-28 05:10:52 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02438%27 HTTP/1.1" 200 None
2026-03-28 05:10:52 [auto1.nl] INFO: Scrape type for WF02438: 0
2026-03-28 05:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:10:52 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 917 | hits on page: 40
2026-03-28 05:10:52 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-28 05:10:52 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-28 05:10:52 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-28 05:10:52 [auto1.nl] INFO: Scrape type for RX16781: 2
2026-03-28 05:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e92ea2-7200-5ede-b54a-85069c359e80 with identifier: RX16781
2026-03-28 05:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e92ea2-7200-5ede-b54a-85069c359e80 with scrape type 2
2026-03-28 05:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e92ea2-7200-5ede-b54a-85069c359e80 with scrape type 2
2026-03-28 05:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99e92ea2-7200-5ede-b54a-85069c359e80, identifier: RX16781
2026-03-28 05:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99e92ea2-7200-5ede-b54a-85069c359e80 with identifier: RX16781
2026-03-28 05:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99e92ea2-7200-5ede-b54a-85069c359e80 with identifier: RX16781
2026-03-28 05:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99e92ea2-7200-5ede-b54a-85069c359e80 with identifier: RX16781 to the API
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:29:44Z',
 'fuel_type': 'hybrid',
 'id': '99e92ea2-7200-5ede-b54a-85069c359e80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX16781',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 176833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2018}
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-28 05:10:52 [auto1.nl] INFO: Saving data for RX16781: {'auction_closing_time': 1774715384.0, 'created_time': 1774552340.591239, 'last_price_update_time': 1774674652.990551}
2026-03-28 05:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RX16781') HTTP/1.1" 204 0
2026-03-28 05:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ05855%27 HTTP/1.1" 200 None
2026-03-28 05:10:53 [auto1.nl] INFO: Scrape type for BZ05855: 0
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-28 05:10:53 [auto1.nl] INFO: Scrape type for LU83430: 2
2026-03-28 05:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a95461-e388-5b7c-8d87-86cf6d16c6ef with identifier: LU83430
2026-03-28 05:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3a95461-e388-5b7c-8d87-86cf6d16c6ef with scrape type 2
2026-03-28 05:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3a95461-e388-5b7c-8d87-86cf6d16c6ef with scrape type 2
2026-03-28 05:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f3a95461-e388-5b7c-8d87-86cf6d16c6ef, identifier: LU83430
2026-03-28 05:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f3a95461-e388-5b7c-8d87-86cf6d16c6ef with identifier: LU83430
2026-03-28 05:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f3a95461-e388-5b7c-8d87-86cf6d16c6ef with identifier: LU83430
2026-03-28 05:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f3a95461-e388-5b7c-8d87-86cf6d16c6ef with identifier: LU83430 to the API
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:15:13Z',
 'fuel_type': 'hybrid',
 'id': 'f3a95461-e388-5b7c-8d87-86cf6d16c6ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU83430',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 264554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-30',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D5 Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2015}
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-28 05:10:53 [auto1.nl] INFO: Saving data for LU83430: {'auction_closing_time': 1774714513.0, 'created_time': 1774552302.610548, 'last_price_update_time': 1774674653.461006}
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LU83430') HTTP/1.1" 204 0
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP94169%27 HTTP/1.1" 200 None
2026-03-28 05:10:53 [auto1.nl] INFO: Scrape type for GP94169: 0
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-28 05:10:53 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-28 05:10:53 [auto1.nl] INFO: Scrape type for JK88621: 2
2026-03-28 05:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2ffd782-cdd8-5b4e-8f07-452f43cee333 with identifier: JK88621
2026-03-28 05:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2ffd782-cdd8-5b4e-8f07-452f43cee333 with scrape type 2
2026-03-28 05:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2ffd782-cdd8-5b4e-8f07-452f43cee333 with scrape type 2
2026-03-28 05:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a2ffd782-cdd8-5b4e-8f07-452f43cee333, identifier: JK88621
2026-03-28 05:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a2ffd782-cdd8-5b4e-8f07-452f43cee333 with identifier: JK88621
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 05:10:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a2ffd782-cdd8-5b4e-8f07-452f43cee333 with identifier: JK88621
2026-03-28 05:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a2ffd782-cdd8-5b4e-8f07-452f43cee333 with identifier: JK88621 to the API
2026-03-28 05:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:32:50Z',
 'fuel_type': 'petrol',
 'id': 'a2ffd782-cdd8-5b4e-8f07-452f43cee333',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK88621',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 126720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-01',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2009}
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-28 05:10:54 [auto1.nl] INFO: Saving data for JK88621: {'auction_closing_time': 1774715570.0, 'created_time': 1774552323.677408, 'last_price_update_time': 1774674654.109987}
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK88621') HTTP/1.1" 204 0
2026-03-28 05:10:54 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-28 05:10:54 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-28 05:10:54 [auto1.nl] INFO: Scrape type for AJ38016: 2
2026-03-28 05:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with identifier: AJ38016
2026-03-28 05:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with scrape type 2
2026-03-28 05:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with scrape type 2
2026-03-28 05:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f, identifier: AJ38016
2026-03-28 05:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with identifier: AJ38016
2026-03-28 05:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with identifier: AJ38016
2026-03-28 05:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with identifier: AJ38016 to the API
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:14:26Z',
 'fuel_type': 'petrol',
 'id': 'd68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ38016',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 290927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-12',
 'seller_name': None,
 'title': 'Volvo XC90 2.9 T6 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2004}
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-28 05:10:54 [auto1.nl] INFO: Saving data for AJ38016: {'auction_closing_time': 1774714466.0, 'created_time': 1774440705.356623, 'last_price_update_time': 1774674654.518218}
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AJ38016') HTTP/1.1" 204 0
2026-03-28 05:10:54 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN29511%27 HTTP/1.1" 200 None
2026-03-28 05:10:54 [auto1.nl] INFO: Scrape type for LN29511: 0
2026-03-28 05:10:54 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-28 05:10:54 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55235%27 HTTP/1.1" 200 None
2026-03-28 05:10:54 [auto1.nl] INFO: Scrape type for EF55235: 0
2026-03-28 05:10:54 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-28 05:10:54 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF44438%27 HTTP/1.1" 200 None
2026-03-28 05:10:54 [auto1.nl] INFO: Scrape type for JF44438: 0
2026-03-28 05:10:54 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM94423%27 HTTP/1.1" 200 None
2026-03-28 05:10:54 [auto1.nl] INFO: Scrape type for MM94423: 2
2026-03-28 05:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3441962c-15e9-5bbc-a144-dde18c928bfe with identifier: MM94423
2026-03-28 05:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3441962c-15e9-5bbc-a144-dde18c928bfe with scrape type 2
2026-03-28 05:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3441962c-15e9-5bbc-a144-dde18c928bfe with scrape type 2
2026-03-28 05:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3441962c-15e9-5bbc-a144-dde18c928bfe, identifier: MM94423
2026-03-28 05:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3441962c-15e9-5bbc-a144-dde18c928bfe with identifier: MM94423
2026-03-28 05:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3441962c-15e9-5bbc-a144-dde18c928bfe with identifier: MM94423
2026-03-28 05:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3441962c-15e9-5bbc-a144-dde18c928bfe with identifier: MM94423 to the API
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:32:06Z',
 'fuel_type': 'petrol',
 'id': '3441962c-15e9-5bbc-a144-dde18c928bfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM94423',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 193337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-27',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2015}
2026-03-28 05:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM94423%27 HTTP/1.1" 200 None
2026-03-28 05:10:55 [auto1.nl] INFO: Saving data for MM94423: {'auction_closing_time': 1774715526.0, 'created_time': 1774465902.35183, 'last_price_update_time': 1774674655.005137}
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MM94423') HTTP/1.1" 204 0
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-28 05:10:55 [auto1.nl] INFO: Scrape type for JG46150: 0
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-28 05:10:55 [auto1.nl] INFO: Scrape type for VB13156: 0
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LM76108%27 HTTP/1.1" 200 None
2026-03-28 05:10:55 [auto1.nl] INFO: Scrape type for LM76108: 0
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC25819%27 HTTP/1.1" 200 None
2026-03-28 05:10:55 [auto1.nl] INFO: Scrape type for PC25819: 2
2026-03-28 05:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20213ed9-5bb1-518c-986b-8dfce9e04842 with identifier: PC25819
2026-03-28 05:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20213ed9-5bb1-518c-986b-8dfce9e04842 with scrape type 2
2026-03-28 05:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20213ed9-5bb1-518c-986b-8dfce9e04842 with scrape type 2
2026-03-28 05:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20213ed9-5bb1-518c-986b-8dfce9e04842, identifier: PC25819
2026-03-28 05:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20213ed9-5bb1-518c-986b-8dfce9e04842 with identifier: PC25819
2026-03-28 05:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20213ed9-5bb1-518c-986b-8dfce9e04842 with identifier: PC25819
2026-03-28 05:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20213ed9-5bb1-518c-986b-8dfce9e04842 with identifier: PC25819 to the API
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:19:13Z',
 'fuel_type': 'petrol',
 'id': '20213ed9-5bb1-518c-986b-8dfce9e04842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC25819',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 166440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2017}
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC25819%27 HTTP/1.1" 200 None
2026-03-28 05:10:55 [auto1.nl] INFO: Saving data for PC25819: {'auction_closing_time': 1774714753.0, 'created_time': 1774466005.276978, 'last_price_update_time': 1774674655.590444}
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PC25819') HTTP/1.1" 204 0
2026-03-28 05:10:55 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-28 05:10:55 [auto1.nl] INFO: Scrape type for FL02627: 2
2026-03-28 05:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with identifier: FL02627
2026-03-28 05:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with scrape type 2
2026-03-28 05:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with scrape type 2
2026-03-28 05:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab, identifier: FL02627
2026-03-28 05:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with identifier: FL02627
2026-03-28 05:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with identifier: FL02627
2026-03-28 05:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with identifier: FL02627 to the API
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:52:49Z',
 'fuel_type': 'petrol',
 'id': '3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL02627',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 147537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'BMW 3er 320i xDrive Sport Line Shadow',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line Shadow',
 'year': 2019}
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-28 05:10:56 [auto1.nl] INFO: Saving data for FL02627: {'auction_closing_time': 1774716769.0, 'created_time': 1774552352.681602, 'last_price_update_time': 1774674656.05058}
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FL02627') HTTP/1.1" 204 0
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC83701%27 HTTP/1.1" 200 None
2026-03-28 05:10:56 [auto1.nl] INFO: Scrape type for UC83701: 2
2026-03-28 05:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ec73e3a-bafd-52a5-9fb5-5fa3011bbdea with identifier: UC83701
2026-03-28 05:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ec73e3a-bafd-52a5-9fb5-5fa3011bbdea with scrape type 2
2026-03-28 05:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ec73e3a-bafd-52a5-9fb5-5fa3011bbdea with scrape type 2
2026-03-28 05:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ec73e3a-bafd-52a5-9fb5-5fa3011bbdea, identifier: UC83701
2026-03-28 05:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ec73e3a-bafd-52a5-9fb5-5fa3011bbdea with identifier: UC83701
2026-03-28 05:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ec73e3a-bafd-52a5-9fb5-5fa3011bbdea with identifier: UC83701
2026-03-28 05:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ec73e3a-bafd-52a5-9fb5-5fa3011bbdea with identifier: UC83701 to the API
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:02:32Z',
 'fuel_type': 'petrol',
 'id': '7ec73e3a-bafd-52a5-9fb5-5fa3011bbdea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC83701',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 87063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-23',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC83701%27 HTTP/1.1" 200 None
2026-03-28 05:10:56 [auto1.nl] INFO: Saving data for UC83701: {'auction_closing_time': 1774713752.0, 'created_time': 1774465866.937313, 'last_price_update_time': 1774674656.484094}
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC83701') HTTP/1.1" 204 0
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN34137%27 HTTP/1.1" 200 None
2026-03-28 05:10:56 [auto1.nl] INFO: Scrape type for PN34137: 0
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AU62322%27 HTTP/1.1" 200 None
2026-03-28 05:10:56 [auto1.nl] INFO: Scrape type for AU62322: 0
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-28 05:10:56 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-28 05:10:56 [auto1.nl] INFO: Scrape type for VD56637: 0
2026-03-28 05:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:10:57 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 917 | hits on page: 40
2026-03-28 05:10:57 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-28 05:10:57 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-28 05:10:57 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-28 05:10:57 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-28 05:10:57 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-28 05:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS68012%27 HTTP/1.1" 200 None
2026-03-28 05:10:57 [auto1.nl] INFO: Scrape type for YS68012: 0
2026-03-28 05:10:57 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-28 05:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS79214%27 HTTP/1.1" 200 None
2026-03-28 05:10:57 [auto1.nl] INFO: Scrape type for AS79214: 2
2026-03-28 05:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce42179-3b2e-576b-afbc-4137652a19e0 with identifier: AS79214
2026-03-28 05:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce42179-3b2e-576b-afbc-4137652a19e0 with scrape type 2
2026-03-28 05:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ce42179-3b2e-576b-afbc-4137652a19e0 with scrape type 2
2026-03-28 05:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ce42179-3b2e-576b-afbc-4137652a19e0, identifier: AS79214
2026-03-28 05:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ce42179-3b2e-576b-afbc-4137652a19e0 with identifier: AS79214
2026-03-28 05:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ce42179-3b2e-576b-afbc-4137652a19e0 with identifier: AS79214
2026-03-28 05:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ce42179-3b2e-576b-afbc-4137652a19e0 with identifier: AS79214 to the API
2026-03-28 05:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-28T16:31:26Z',
 'fuel_type': 'petrol',
 'id': '7ce42179-3b2e-576b-afbc-4137652a19e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS79214',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 80766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-30',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS79214%27 HTTP/1.1" 200 None
2026-03-28 05:10:58 [auto1.nl] INFO: Saving data for AS79214: {'auction_closing_time': 1774715486.0, 'created_time': 1774465886.861707, 'last_price_update_time': 1774674658.042255}
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AS79214') HTTP/1.1" 204 0
2026-03-28 05:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:10:58 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22274%27 HTTP/1.1" 200 None
2026-03-28 05:10:58 [auto1.nl] INFO: Scrape type for SV22274: 2
2026-03-28 05:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb920f5-ca10-5c5c-bbae-16d38e05ab98 with identifier: SV22274
2026-03-28 05:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb920f5-ca10-5c5c-bbae-16d38e05ab98 with scrape type 2
2026-03-28 05:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeb920f5-ca10-5c5c-bbae-16d38e05ab98 with scrape type 2
2026-03-28 05:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aeb920f5-ca10-5c5c-bbae-16d38e05ab98, identifier: SV22274
2026-03-28 05:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aeb920f5-ca10-5c5c-bbae-16d38e05ab98 with identifier: SV22274
2026-03-28 05:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aeb920f5-ca10-5c5c-bbae-16d38e05ab98 with identifier: SV22274
2026-03-28 05:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aeb920f5-ca10-5c5c-bbae-16d38e05ab98 with identifier: SV22274 to the API
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:35:27Z',
 'fuel_type': 'petrol',
 'id': 'aeb920f5-ca10-5c5c-bbae-16d38e05ab98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV22274',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 120296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22274%27 HTTP/1.1" 200 None
2026-03-28 05:10:58 [auto1.nl] INFO: Saving data for SV22274: {'auction_closing_time': 1774715727.0, 'created_time': 1774465849.853485, 'last_price_update_time': 1774674658.567023}
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV22274') HTTP/1.1" 204 0
2026-03-28 05:10:58 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-28 05:10:58 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-28 05:10:58 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD33602%27 HTTP/1.1" 200 None
2026-03-28 05:10:58 [auto1.nl] INFO: Scrape type for FD33602: 2
2026-03-28 05:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c90037e-5b67-52d9-8a32-3504be94e771 with identifier: FD33602
2026-03-28 05:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c90037e-5b67-52d9-8a32-3504be94e771 with scrape type 2
2026-03-28 05:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c90037e-5b67-52d9-8a32-3504be94e771 with scrape type 2
2026-03-28 05:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9c90037e-5b67-52d9-8a32-3504be94e771, identifier: FD33602
2026-03-28 05:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9c90037e-5b67-52d9-8a32-3504be94e771 with identifier: FD33602
2026-03-28 05:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9c90037e-5b67-52d9-8a32-3504be94e771 with identifier: FD33602
2026-03-28 05:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9c90037e-5b67-52d9-8a32-3504be94e771 with identifier: FD33602 to the API
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:55:18Z',
 'fuel_type': 'petrol',
 'id': '9c90037e-5b67-52d9-8a32-3504be94e771',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD33602',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 149316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2017}
2026-03-28 05:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD33602%27 HTTP/1.1" 200 None
2026-03-28 05:10:59 [auto1.nl] INFO: Saving data for FD33602: {'auction_closing_time': 1774716918.0, 'created_time': 1774465975.557554, 'last_price_update_time': 1774674659.004952}
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD33602') HTTP/1.1" 204 0
2026-03-28 05:10:59 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP56929%27 HTTP/1.1" 200 None
2026-03-28 05:10:59 [auto1.nl] INFO: Scrape type for UP56929: 0
2026-03-28 05:10:59 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TK93788%27 HTTP/1.1" 200 None
2026-03-28 05:10:59 [auto1.nl] INFO: Scrape type for TK93788: 0
2026-03-28 05:10:59 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-28 05:10:59 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-28 05:10:59 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-28 05:10:59 [auto1.nl] INFO: Scrape type for BZ75535: 2
2026-03-28 05:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88555a79-79bd-5269-bd22-a9bbeac100f4 with identifier: BZ75535
2026-03-28 05:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88555a79-79bd-5269-bd22-a9bbeac100f4 with scrape type 2
2026-03-28 05:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88555a79-79bd-5269-bd22-a9bbeac100f4 with scrape type 2
2026-03-28 05:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 88555a79-79bd-5269-bd22-a9bbeac100f4, identifier: BZ75535
2026-03-28 05:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 88555a79-79bd-5269-bd22-a9bbeac100f4 with identifier: BZ75535
2026-03-28 05:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 88555a79-79bd-5269-bd22-a9bbeac100f4 with identifier: BZ75535
2026-03-28 05:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 88555a79-79bd-5269-bd22-a9bbeac100f4 with identifier: BZ75535 to the API
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:40:46Z',
 'fuel_type': 'diesel',
 'id': '88555a79-79bd-5269-bd22-a9bbeac100f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ75535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 225365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-29',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Carat BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat BlueMotion',
 'year': 2014}
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-28 05:10:59 [auto1.nl] INFO: Saving data for BZ75535: {'auction_closing_time': 1774716046.0, 'created_time': 1774552343.744415, 'last_price_update_time': 1774674659.458154}
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ75535') HTTP/1.1" 204 0
2026-03-28 05:10:59 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-28 05:10:59 [auto1.nl] INFO: Scrape type for XD61678: 0
2026-03-28 05:10:59 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX58095%27 HTTP/1.1" 200 None
2026-03-28 05:10:59 [auto1.nl] INFO: Scrape type for NX58095: 2
2026-03-28 05:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ae6e80-211c-59d3-92a6-ff7e06e68ac9 with identifier: NX58095
2026-03-28 05:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8ae6e80-211c-59d3-92a6-ff7e06e68ac9 with scrape type 2
2026-03-28 05:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8ae6e80-211c-59d3-92a6-ff7e06e68ac9 with scrape type 2
2026-03-28 05:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b8ae6e80-211c-59d3-92a6-ff7e06e68ac9, identifier: NX58095
2026-03-28 05:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b8ae6e80-211c-59d3-92a6-ff7e06e68ac9 with identifier: NX58095
2026-03-28 05:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b8ae6e80-211c-59d3-92a6-ff7e06e68ac9 with identifier: NX58095
2026-03-28 05:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b8ae6e80-211c-59d3-92a6-ff7e06e68ac9 with identifier: NX58095 to the API
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:27:55Z',
 'fuel_type': 'petrol',
 'id': 'b8ae6e80-211c-59d3-92a6-ff7e06e68ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX58095',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 103840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-28',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX58095%27 HTTP/1.1" 200 None
2026-03-28 05:10:59 [auto1.nl] INFO: Saving data for NX58095: {'auction_closing_time': 1774715275.0, 'created_time': 1774465878.46913, 'last_price_update_time': 1774674659.923785}
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX58095') HTTP/1.1" 204 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for XA55617: 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH47891%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for BH47891: 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST98483%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for ST98483: 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV50646%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for ZV50646: 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for FL22944: 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for BM96536: 2
2026-03-28 05:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3862e252-f0ce-50cc-a3da-a91b54671470 with identifier: BM96536
2026-03-28 05:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3862e252-f0ce-50cc-a3da-a91b54671470 with scrape type 2
2026-03-28 05:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3862e252-f0ce-50cc-a3da-a91b54671470 with scrape type 2
2026-03-28 05:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3862e252-f0ce-50cc-a3da-a91b54671470, identifier: BM96536
2026-03-28 05:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3862e252-f0ce-50cc-a3da-a91b54671470 with identifier: BM96536
2026-03-28 05:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3862e252-f0ce-50cc-a3da-a91b54671470 with identifier: BM96536
2026-03-28 05:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3862e252-f0ce-50cc-a3da-a91b54671470 with identifier: BM96536 to the API
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:13Z',
 'fuel_type': 'diesel',
 'id': '3862e252-f0ce-50cc-a3da-a91b54671470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM96536',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 117028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Saving data for BM96536: {'auction_closing_time': 1774716193.0, 'created_time': 1774552320.067762, 'last_price_update_time': 1774674660.562318}
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM96536') HTTP/1.1" 204 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP53707%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for ZP53707: 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS66279%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for DS66279: 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS83136%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for RS83136: 0
2026-03-28 05:11:00 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-28 05:11:00 [auto1.nl] INFO: Scrape type for BD37870: 2
2026-03-28 05:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with identifier: BD37870
2026-03-28 05:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with scrape type 2
2026-03-28 05:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with scrape type 2
2026-03-28 05:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7, identifier: BD37870
2026-03-28 05:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with identifier: BD37870
2026-03-28 05:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with identifier: BD37870
2026-03-28 05:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with identifier: BD37870 to the API
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:29:55Z',
 'fuel_type': 'petrol',
 'id': '83458b5c-b0f8-5c88-85f2-01291ea4ccb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD37870',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 176745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-10-26',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.3 Comfort 1300',
 'transmission': 'manual',
 'trim': 'Comfort 1300',
 'year': 2001}
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Saving data for BD37870: {'auction_closing_time': 1774715395.0, 'created_time': 1774552271.300788, 'last_price_update_time': 1774674661.053027}
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD37870') HTTP/1.1" 204 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK22988%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for PK22988: 2
2026-03-28 05:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb999536-54d6-5879-a72a-12df3d61af25 with identifier: PK22988
2026-03-28 05:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb999536-54d6-5879-a72a-12df3d61af25 with scrape type 2
2026-03-28 05:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb999536-54d6-5879-a72a-12df3d61af25 with scrape type 2
2026-03-28 05:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bb999536-54d6-5879-a72a-12df3d61af25, identifier: PK22988
2026-03-28 05:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bb999536-54d6-5879-a72a-12df3d61af25 with identifier: PK22988
2026-03-28 05:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bb999536-54d6-5879-a72a-12df3d61af25 with identifier: PK22988
2026-03-28 05:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bb999536-54d6-5879-a72a-12df3d61af25 with identifier: PK22988 to the API
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:29:04Z',
 'fuel_type': 'diesel',
 'id': 'bb999536-54d6-5879-a72a-12df3d61af25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK22988',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 557112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Kasten',
 'transmission': 'automatic',
 'trim': 'Maxi Kasten',
 'year': 2012}
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK22988%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Saving data for PK22988: {'auction_closing_time': 1774715344.0, 'created_time': 1774465902.840821, 'last_price_update_time': 1774674661.600649}
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PK22988') HTTP/1.1" 204 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL29308%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for HL29308: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for DG66253: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL71666%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for WL71666: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-28 05:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:01 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG13282%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for BG13282: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT24375%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for AT24375: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK53801%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for MK53801: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for SV01425: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN10776%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for NN10776: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD16289%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for PD16289: 0
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-28 05:11:01 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK38952%27 HTTP/1.1" 200 None
2026-03-28 05:11:01 [auto1.nl] INFO: Scrape type for AK38952: 2
2026-03-28 05:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0f2ea42-b89c-5d51-8ff2-cb6b2c77e506 with identifier: AK38952
2026-03-28 05:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0f2ea42-b89c-5d51-8ff2-cb6b2c77e506 with scrape type 2
2026-03-28 05:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0f2ea42-b89c-5d51-8ff2-cb6b2c77e506 with scrape type 2
2026-03-28 05:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e0f2ea42-b89c-5d51-8ff2-cb6b2c77e506, identifier: AK38952
2026-03-28 05:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e0f2ea42-b89c-5d51-8ff2-cb6b2c77e506 with identifier: AK38952
2026-03-28 05:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e0f2ea42-b89c-5d51-8ff2-cb6b2c77e506 with identifier: AK38952
2026-03-28 05:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e0f2ea42-b89c-5d51-8ff2-cb6b2c77e506 with identifier: AK38952 to the API
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-28T16:24:14Z',
 'fuel_type': 'petrol',
 'id': 'e0f2ea42-b89c-5d51-8ff2-cb6b2c77e506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK38952',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 67663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-31',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK38952%27 HTTP/1.1" 200 None
2026-03-28 05:11:02 [auto1.nl] INFO: Saving data for AK38952: {'auction_closing_time': 1774715054.0, 'created_time': 1774465956.78427, 'last_price_update_time': 1774674662.402317}
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AK38952') HTTP/1.1" 204 0
2026-03-28 05:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:11:02 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-28 05:11:02 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-28 05:11:02 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR94083%27 HTTP/1.1" 200 None
2026-03-28 05:11:02 [auto1.nl] INFO: Scrape type for JR94083: 0
2026-03-28 05:11:02 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN78419%27 HTTP/1.1" 200 None
2026-03-28 05:11:02 [auto1.nl] INFO: Scrape type for GN78419: 2
2026-03-28 05:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87975769-ada1-5345-95c9-7b641d4d0c57 with identifier: GN78419
2026-03-28 05:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87975769-ada1-5345-95c9-7b641d4d0c57 with scrape type 2
2026-03-28 05:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87975769-ada1-5345-95c9-7b641d4d0c57 with scrape type 2
2026-03-28 05:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 87975769-ada1-5345-95c9-7b641d4d0c57, identifier: GN78419
2026-03-28 05:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 87975769-ada1-5345-95c9-7b641d4d0c57 with identifier: GN78419
2026-03-28 05:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 87975769-ada1-5345-95c9-7b641d4d0c57 with identifier: GN78419
2026-03-28 05:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 87975769-ada1-5345-95c9-7b641d4d0c57 with identifier: GN78419 to the API
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:49:09Z',
 'fuel_type': 'petrol',
 'id': '87975769-ada1-5345-95c9-7b641d4d0c57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN78419',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 32109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-25',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2023}
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN78419%27 HTTP/1.1" 200 None
2026-03-28 05:11:02 [auto1.nl] INFO: Saving data for GN78419: {'auction_closing_time': 1774716549.0, 'created_time': 1774466004.519686, 'last_price_update_time': 1774674662.967772}
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN78419') HTTP/1.1" 204 0
2026-03-28 05:11:02 [auto1.nl] INFO: Found listing with ID: BF56002
2026-03-28 05:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF56002%27 HTTP/1.1" 200 None
2026-03-28 05:11:03 [auto1.nl] INFO: Scrape type for BF56002: 0
2026-03-28 05:11:03 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-28 05:11:03 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-28 05:11:03 [auto1.nl] INFO: Scrape type for YK98733: 0
2026-03-28 05:11:03 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN62257%27 HTTP/1.1" 200 None
2026-03-28 05:11:03 [auto1.nl] INFO: Scrape type for JN62257: 2
2026-03-28 05:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54110cfa-9432-5b8a-a920-37d08825ae30 with identifier: JN62257
2026-03-28 05:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54110cfa-9432-5b8a-a920-37d08825ae30 with scrape type 2
2026-03-28 05:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54110cfa-9432-5b8a-a920-37d08825ae30 with scrape type 2
2026-03-28 05:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 54110cfa-9432-5b8a-a920-37d08825ae30, identifier: JN62257
2026-03-28 05:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 54110cfa-9432-5b8a-a920-37d08825ae30 with identifier: JN62257
2026-03-28 05:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 54110cfa-9432-5b8a-a920-37d08825ae30 with identifier: JN62257
2026-03-28 05:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 54110cfa-9432-5b8a-a920-37d08825ae30 with identifier: JN62257 to the API
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:36:22Z',
 'fuel_type': 'diesel',
 'id': '54110cfa-9432-5b8a-a920-37d08825ae30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN62257',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 417255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-13',
 'seller_name': None,
 'title': 'Lancia Voyager 2.8 JTDM Silver',
 'transmission': 'automatic',
 'trim': 'Silver',
 'year': 2014}
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN62257%27 HTTP/1.1" 200 None
2026-03-28 05:11:03 [auto1.nl] INFO: Saving data for JN62257: {'auction_closing_time': 1774715782.0, 'created_time': 1773343172.464189, 'last_price_update_time': 1774674663.439314}
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JN62257') HTTP/1.1" 204 0
2026-03-28 05:11:03 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-28 05:11:03 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-28 05:11:03 [auto1.nl] INFO: Scrape type for RX80263: 0
2026-03-28 05:11:03 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH52378%27 HTTP/1.1" 200 None
2026-03-28 05:11:03 [auto1.nl] INFO: Scrape type for GH52378: 0
2026-03-28 05:11:03 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ87592%27 HTTP/1.1" 200 None
2026-03-28 05:11:03 [auto1.nl] INFO: Scrape type for YZ87592: 2
2026-03-28 05:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb411fd6-e1eb-5eb2-99ec-43af6e48d2d3 with identifier: YZ87592
2026-03-28 05:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb411fd6-e1eb-5eb2-99ec-43af6e48d2d3 with scrape type 2
2026-03-28 05:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb411fd6-e1eb-5eb2-99ec-43af6e48d2d3 with scrape type 2
2026-03-28 05:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eb411fd6-e1eb-5eb2-99ec-43af6e48d2d3, identifier: YZ87592
2026-03-28 05:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eb411fd6-e1eb-5eb2-99ec-43af6e48d2d3 with identifier: YZ87592
2026-03-28 05:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eb411fd6-e1eb-5eb2-99ec-43af6e48d2d3 with identifier: YZ87592
2026-03-28 05:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eb411fd6-e1eb-5eb2-99ec-43af6e48d2d3 with identifier: YZ87592 to the API
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:19:28Z',
 'fuel_type': 'petrol',
 'id': 'eb411fd6-e1eb-5eb2-99ec-43af6e48d2d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ87592',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 180888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ87592%27 HTTP/1.1" 200 None
2026-03-28 05:11:03 [auto1.nl] INFO: Saving data for YZ87592: {'auction_closing_time': 1774714768.0, 'created_time': 1773232434.857245, 'last_price_update_time': 1774674663.923231}
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ87592') HTTP/1.1" 204 0
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG63476%27 HTTP/1.1" 200 None
2026-03-28 05:11:04 [auto1.nl] INFO: Scrape type for TG63476: 0
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-28 05:11:04 [auto1.nl] INFO: Scrape type for HW48392: 2
2026-03-28 05:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b034c21d-dcfd-5dcb-b9ea-4be310699681 with identifier: HW48392
2026-03-28 05:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b034c21d-dcfd-5dcb-b9ea-4be310699681 with scrape type 2
2026-03-28 05:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b034c21d-dcfd-5dcb-b9ea-4be310699681 with scrape type 2
2026-03-28 05:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b034c21d-dcfd-5dcb-b9ea-4be310699681, identifier: HW48392
2026-03-28 05:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b034c21d-dcfd-5dcb-b9ea-4be310699681 with identifier: HW48392
2026-03-28 05:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b034c21d-dcfd-5dcb-b9ea-4be310699681 with identifier: HW48392
2026-03-28 05:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b034c21d-dcfd-5dcb-b9ea-4be310699681 with identifier: HW48392 to the API
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:14:03Z',
 'fuel_type': 'petrol',
 'id': 'b034c21d-dcfd-5dcb-b9ea-4be310699681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW48392',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-02',
 'seller_name': None,
 'title': 'BMW 5er 530i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-28 05:11:04 [auto1.nl] INFO: Saving data for HW48392: {'auction_closing_time': 1774714443.0, 'created_time': 1774552304.630107, 'last_price_update_time': 1774674664.457111}
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW48392') HTTP/1.1" 204 0
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-28 05:11:04 [auto1.nl] INFO: Scrape type for WJ55319: 0
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA29712%27 HTTP/1.1" 200 None
2026-03-28 05:11:04 [auto1.nl] INFO: Scrape type for NA29712: 0
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL27027%27 HTTP/1.1" 200 None
2026-03-28 05:11:04 [auto1.nl] INFO: Scrape type for RL27027: 0
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-28 05:11:04 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-28 05:11:04 [auto1.nl] INFO: Scrape type for GY41852: 2
2026-03-28 05:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f8592ce-bc10-53f6-9c07-795ec47b0001 with identifier: GY41852
2026-03-28 05:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8592ce-bc10-53f6-9c07-795ec47b0001 with scrape type 2
2026-03-28 05:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f8592ce-bc10-53f6-9c07-795ec47b0001 with scrape type 2
2026-03-28 05:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7f8592ce-bc10-53f6-9c07-795ec47b0001, identifier: GY41852
2026-03-28 05:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7f8592ce-bc10-53f6-9c07-795ec47b0001 with identifier: GY41852
2026-03-28 05:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7f8592ce-bc10-53f6-9c07-795ec47b0001 with identifier: GY41852
2026-03-28 05:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7f8592ce-bc10-53f6-9c07-795ec47b0001 with identifier: GY41852 to the API
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:20:33Z',
 'fuel_type': 'hybrid',
 'id': '7f8592ce-bc10-53f6-9c07-795ec47b0001',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY41852',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 100137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-31',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-28 05:11:04 [auto1.nl] INFO: Saving data for GY41852: {'auction_closing_time': 1774714833.0, 'created_time': 1774552315.514399, 'last_price_update_time': 1774674664.973065}
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY41852') HTTP/1.1" 204 0
2026-03-28 05:11:05 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-28 05:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:05 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:05 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-28 05:11:05 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-28 05:11:05 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-28 05:11:05 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-28 05:11:05 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL15145%27 HTTP/1.1" 200 None
2026-03-28 05:11:05 [auto1.nl] INFO: Scrape type for HL15145: 2
2026-03-28 05:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd421197-ccad-5acb-9e12-3ddab112bde8 with identifier: HL15145
2026-03-28 05:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd421197-ccad-5acb-9e12-3ddab112bde8 with scrape type 2
2026-03-28 05:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd421197-ccad-5acb-9e12-3ddab112bde8 with scrape type 2
2026-03-28 05:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bd421197-ccad-5acb-9e12-3ddab112bde8, identifier: HL15145
2026-03-28 05:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bd421197-ccad-5acb-9e12-3ddab112bde8 with identifier: HL15145
2026-03-28 05:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bd421197-ccad-5acb-9e12-3ddab112bde8 with identifier: HL15145
2026-03-28 05:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bd421197-ccad-5acb-9e12-3ddab112bde8 with identifier: HL15145 to the API
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:50:16Z',
 'fuel_type': 'hybrid',
 'id': 'bd421197-ccad-5acb-9e12-3ddab112bde8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL15145',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 201650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-01',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2015}
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL15145%27 HTTP/1.1" 200 None
2026-03-28 05:11:05 [auto1.nl] INFO: Saving data for HL15145: {'auction_closing_time': 1774716616.0, 'created_time': 1774465976.457584, 'last_price_update_time': 1774674665.959149}
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HL15145') HTTP/1.1" 204 0
2026-03-28 05:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:11:05 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-28 05:11:05 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH65457%27 HTTP/1.1" 200 None
2026-03-28 05:11:05 [auto1.nl] INFO: Scrape type for JH65457: 2
2026-03-28 05:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e068e11-0c98-55a2-b00e-699bd57363fc with identifier: JH65457
2026-03-28 05:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e068e11-0c98-55a2-b00e-699bd57363fc with scrape type 2
2026-03-28 05:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e068e11-0c98-55a2-b00e-699bd57363fc with scrape type 2
2026-03-28 05:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e068e11-0c98-55a2-b00e-699bd57363fc, identifier: JH65457
2026-03-28 05:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e068e11-0c98-55a2-b00e-699bd57363fc with identifier: JH65457
2026-03-28 05:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e068e11-0c98-55a2-b00e-699bd57363fc with identifier: JH65457
2026-03-28 05:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e068e11-0c98-55a2-b00e-699bd57363fc with identifier: JH65457 to the API
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:20:47Z',
 'fuel_type': 'petrol',
 'id': '0e068e11-0c98-55a2-b00e-699bd57363fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH65457',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 135374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-03',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2006}
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH65457%27 HTTP/1.1" 200 None
2026-03-28 05:11:06 [auto1.nl] INFO: Saving data for JH65457: {'auction_closing_time': 1774714847.0, 'created_time': 1774465912.011314, 'last_price_update_time': 1774674666.3762}
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH65457') HTTP/1.1" 204 0
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG59138%27 HTTP/1.1" 200 None
2026-03-28 05:11:06 [auto1.nl] INFO: Scrape type for NG59138: 0
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX87837%27 HTTP/1.1" 200 None
2026-03-28 05:11:06 [auto1.nl] INFO: Scrape type for RX87837: 0
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG73581%27 HTTP/1.1" 200 None
2026-03-28 05:11:06 [auto1.nl] INFO: Scrape type for DG73581: 0
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-28 05:11:06 [auto1.nl] INFO: Scrape type for JS13271: 2
2026-03-28 05:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with identifier: JS13271
2026-03-28 05:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with scrape type 2
2026-03-28 05:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with scrape type 2
2026-03-28 05:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5, identifier: JS13271
2026-03-28 05:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with identifier: JS13271
2026-03-28 05:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with identifier: JS13271
2026-03-28 05:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with identifier: JS13271 to the API
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:23:47Z',
 'fuel_type': 'petrol',
 'id': '0bfd9b93-5cba-523d-ac0d-9ba97d580fe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS13271',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 100765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-28 05:11:06 [auto1.nl] INFO: Saving data for JS13271: {'auction_closing_time': 1774715027.0, 'created_time': 1774552350.407712, 'last_price_update_time': 1774674666.85803}
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JS13271') HTTP/1.1" 204 0
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: GM40908
2026-03-28 05:11:06 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-28 05:11:06 [auto1.nl] INFO: Scrape type for NB25760: 2
2026-03-28 05:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8983b51f-d266-597e-bb8a-b736d0e6f2ea with identifier: NB25760
2026-03-28 05:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8983b51f-d266-597e-bb8a-b736d0e6f2ea with scrape type 2
2026-03-28 05:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8983b51f-d266-597e-bb8a-b736d0e6f2ea with scrape type 2
2026-03-28 05:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8983b51f-d266-597e-bb8a-b736d0e6f2ea, identifier: NB25760
2026-03-28 05:11:07 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 13 pages/min), scraped 45 items (at 45 items/min)
2026-03-28 05:11:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-28 05:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8983b51f-d266-597e-bb8a-b736d0e6f2ea with identifier: NB25760
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 05:11:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8983b51f-d266-597e-bb8a-b736d0e6f2ea with identifier: NB25760
2026-03-28 05:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8983b51f-d266-597e-bb8a-b736d0e6f2ea with identifier: NB25760 to the API
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:20:40Z',
 'fuel_type': 'petrol',
 'id': '8983b51f-d266-597e-bb8a-b736d0e6f2ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB25760',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 285689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-12',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2008}
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-28 05:11:07 [auto1.nl] INFO: Saving data for NB25760: {'auction_closing_time': 1774714840.0, 'created_time': 1774552334.796662, 'last_price_update_time': 1774674667.499416}
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NB25760') HTTP/1.1" 204 0
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE69449%27 HTTP/1.1" 200 None
2026-03-28 05:11:07 [auto1.nl] INFO: Scrape type for TE69449: 0
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-28 05:11:07 [auto1.nl] INFO: Scrape type for ME98271: 2
2026-03-28 05:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9322357-e6fb-5984-9120-59bbfc3ba07c with identifier: ME98271
2026-03-28 05:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9322357-e6fb-5984-9120-59bbfc3ba07c with scrape type 2
2026-03-28 05:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9322357-e6fb-5984-9120-59bbfc3ba07c with scrape type 2
2026-03-28 05:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a9322357-e6fb-5984-9120-59bbfc3ba07c, identifier: ME98271
2026-03-28 05:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a9322357-e6fb-5984-9120-59bbfc3ba07c with identifier: ME98271
2026-03-28 05:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a9322357-e6fb-5984-9120-59bbfc3ba07c with identifier: ME98271
2026-03-28 05:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a9322357-e6fb-5984-9120-59bbfc3ba07c with identifier: ME98271 to the API
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:36:33Z',
 'fuel_type': 'petrol',
 'id': 'a9322357-e6fb-5984-9120-59bbfc3ba07c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME98271',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 147929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-25',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Crossborder',
 'transmission': 'automatic',
 'trim': 'Crossborder',
 'year': 2017}
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-28 05:11:07 [auto1.nl] INFO: Saving data for ME98271: {'auction_closing_time': 1774715793.0, 'created_time': 1774552312.515774, 'last_price_update_time': 1774674667.9529}
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME98271') HTTP/1.1" 204 0
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-28 05:11:07 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR08683%27 HTTP/1.1" 200 None
2026-03-28 05:11:07 [auto1.nl] INFO: Scrape type for YR08683: 2
2026-03-28 05:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fa103f6-118a-5fcf-9dfc-ec18c74bef7f with identifier: YR08683
2026-03-28 05:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fa103f6-118a-5fcf-9dfc-ec18c74bef7f with scrape type 2
2026-03-28 05:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fa103f6-118a-5fcf-9dfc-ec18c74bef7f with scrape type 2
2026-03-28 05:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7fa103f6-118a-5fcf-9dfc-ec18c74bef7f, identifier: YR08683
2026-03-28 05:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7fa103f6-118a-5fcf-9dfc-ec18c74bef7f with identifier: YR08683
2026-03-28 05:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7fa103f6-118a-5fcf-9dfc-ec18c74bef7f with identifier: YR08683
2026-03-28 05:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7fa103f6-118a-5fcf-9dfc-ec18c74bef7f with identifier: YR08683 to the API
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:11Z',
 'fuel_type': 'petrol',
 'id': '7fa103f6-118a-5fcf-9dfc-ec18c74bef7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR08683',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 146889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-05',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2015}
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR08683%27 HTTP/1.1" 200 None
2026-03-28 05:11:08 [auto1.nl] INFO: Saving data for YR08683: {'auction_closing_time': 1774714931.0, 'created_time': 1774465854.240998, 'last_price_update_time': 1774674668.391088}
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YR08683') HTTP/1.1" 204 0
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-28 05:11:08 [auto1.nl] INFO: Scrape type for BD28084: 2
2026-03-28 05:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 037ab206-67d4-52ce-9ffe-d7bf1d66198a with identifier: BD28084
2026-03-28 05:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037ab206-67d4-52ce-9ffe-d7bf1d66198a with scrape type 2
2026-03-28 05:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 037ab206-67d4-52ce-9ffe-d7bf1d66198a with scrape type 2
2026-03-28 05:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 037ab206-67d4-52ce-9ffe-d7bf1d66198a, identifier: BD28084
2026-03-28 05:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 037ab206-67d4-52ce-9ffe-d7bf1d66198a with identifier: BD28084
2026-03-28 05:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 037ab206-67d4-52ce-9ffe-d7bf1d66198a with identifier: BD28084
2026-03-28 05:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 037ab206-67d4-52ce-9ffe-d7bf1d66198a with identifier: BD28084 to the API
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:26:27Z',
 'fuel_type': 'petrol',
 'id': '037ab206-67d4-52ce-9ffe-d7bf1d66198a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD28084',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 148076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-23',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2015}
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-28 05:11:08 [auto1.nl] INFO: Saving data for BD28084: {'auction_closing_time': 1774715187.0, 'created_time': 1774552322.040828, 'last_price_update_time': 1774674668.933915}
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD28084') HTTP/1.1" 204 0
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR97495%27 HTTP/1.1" 200 None
2026-03-28 05:11:08 [auto1.nl] INFO: Scrape type for LR97495: 0
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-28 05:11:08 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-28 05:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-28 05:11:09 [auto1.nl] INFO: Scrape type for VT81070: 0
2026-03-28 05:11:09 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-28 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS78971%27 HTTP/1.1" 200 None
2026-03-28 05:11:09 [auto1.nl] INFO: Scrape type for AS78971: 0
2026-03-28 05:11:09 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-28 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN86188%27 HTTP/1.1" 200 None
2026-03-28 05:11:09 [auto1.nl] INFO: Scrape type for TN86188: 0
2026-03-28 05:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:10 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ31508%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for PZ31508: 0
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN23343%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for DN23343: 2
2026-03-28 05:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e73d033-5930-5868-af8f-d8de24cd495c with identifier: DN23343
2026-03-28 05:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e73d033-5930-5868-af8f-d8de24cd495c with scrape type 2
2026-03-28 05:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e73d033-5930-5868-af8f-d8de24cd495c with scrape type 2
2026-03-28 05:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e73d033-5930-5868-af8f-d8de24cd495c, identifier: DN23343
2026-03-28 05:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e73d033-5930-5868-af8f-d8de24cd495c with identifier: DN23343
2026-03-28 05:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e73d033-5930-5868-af8f-d8de24cd495c with identifier: DN23343
2026-03-28 05:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e73d033-5930-5868-af8f-d8de24cd495c with identifier: DN23343 to the API
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:35:01Z',
 'fuel_type': 'petrol',
 'id': '8e73d033-5930-5868-af8f-d8de24cd495c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN23343',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 108131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN23343%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Saving data for DN23343: {'auction_closing_time': 1774715701.0, 'created_time': 1773836735.532557, 'last_price_update_time': 1774674670.580088}
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DN23343') HTTP/1.1" 204 0
2026-03-28 05:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for CP17463: 0
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for EJ39658: 0
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG27565%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for AG27565: 0
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for SX35832: 0
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for RF26708: 0
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV40948%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for RV40948: 0
2026-03-28 05:11:10 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-28 05:11:10 [auto1.nl] INFO: Scrape type for LN13615: 2
2026-03-28 05:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e52b002-561d-5010-a6af-2e404b144b47 with identifier: LN13615
2026-03-28 05:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e52b002-561d-5010-a6af-2e404b144b47 with scrape type 2
2026-03-28 05:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e52b002-561d-5010-a6af-2e404b144b47 with scrape type 2
2026-03-28 05:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e52b002-561d-5010-a6af-2e404b144b47, identifier: LN13615
2026-03-28 05:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e52b002-561d-5010-a6af-2e404b144b47 with identifier: LN13615
2026-03-28 05:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e52b002-561d-5010-a6af-2e404b144b47 with identifier: LN13615
2026-03-28 05:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e52b002-561d-5010-a6af-2e404b144b47 with identifier: LN13615 to the API
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:48:49Z',
 'fuel_type': 'petrol',
 'id': '7e52b002-561d-5010-a6af-2e404b144b47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN13615',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 480773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-18',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-28 05:11:11 [auto1.nl] INFO: Saving data for LN13615: {'auction_closing_time': 1774716529.0, 'created_time': 1774552324.951541, 'last_price_update_time': 1774674671.236766}
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LN13615') HTTP/1.1" 204 0
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV80682%27 HTTP/1.1" 200 None
2026-03-28 05:11:11 [auto1.nl] INFO: Scrape type for CV80682: 2
2026-03-28 05:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ed35644-a1cf-5426-a370-efb1e3b04835 with identifier: CV80682
2026-03-28 05:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ed35644-a1cf-5426-a370-efb1e3b04835 with scrape type 2
2026-03-28 05:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ed35644-a1cf-5426-a370-efb1e3b04835 with scrape type 2
2026-03-28 05:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ed35644-a1cf-5426-a370-efb1e3b04835, identifier: CV80682
2026-03-28 05:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ed35644-a1cf-5426-a370-efb1e3b04835 with identifier: CV80682
2026-03-28 05:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ed35644-a1cf-5426-a370-efb1e3b04835 with identifier: CV80682
2026-03-28 05:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ed35644-a1cf-5426-a370-efb1e3b04835 with identifier: CV80682 to the API
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:00:26Z',
 'fuel_type': 'diesel',
 'id': '3ed35644-a1cf-5426-a370-efb1e3b04835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV80682',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 407300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-09',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2013}
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV80682%27 HTTP/1.1" 200 None
2026-03-28 05:11:11 [auto1.nl] INFO: Saving data for CV80682: {'auction_closing_time': 1774713626.0, 'created_time': 1773343044.583724, 'last_price_update_time': 1774674671.690536}
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CV80682') HTTP/1.1" 204 0
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP01312%27 HTTP/1.1" 200 None
2026-03-28 05:11:11 [auto1.nl] INFO: Scrape type for EP01312: 0
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-28 05:11:11 [auto1.nl] INFO: Scrape type for CR08212: 0
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD71761%27 HTTP/1.1" 200 None
2026-03-28 05:11:11 [auto1.nl] INFO: Scrape type for BD71761: 0
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-28 05:11:11 [auto1.nl] INFO: Scrape type for RD50492: 0
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-28 05:11:11 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65627%27 HTTP/1.1" 200 None
2026-03-28 05:11:11 [auto1.nl] INFO: Scrape type for UU65627: 2
2026-03-28 05:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f19cb44-2991-5e67-a1b8-8a7fac8f4316 with identifier: UU65627
2026-03-28 05:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f19cb44-2991-5e67-a1b8-8a7fac8f4316 with scrape type 2
2026-03-28 05:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f19cb44-2991-5e67-a1b8-8a7fac8f4316 with scrape type 2
2026-03-28 05:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f19cb44-2991-5e67-a1b8-8a7fac8f4316, identifier: UU65627
2026-03-28 05:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f19cb44-2991-5e67-a1b8-8a7fac8f4316 with identifier: UU65627
2026-03-28 05:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f19cb44-2991-5e67-a1b8-8a7fac8f4316 with identifier: UU65627
2026-03-28 05:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f19cb44-2991-5e67-a1b8-8a7fac8f4316 with identifier: UU65627 to the API
2026-03-28 05:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:10:46Z',
 'fuel_type': 'diesel',
 'id': '3f19cb44-2991-5e67-a1b8-8a7fac8f4316',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU65627',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 341881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65627%27 HTTP/1.1" 200 None
2026-03-28 05:11:12 [auto1.nl] INFO: Saving data for UU65627: {'auction_closing_time': 1774714246.0, 'created_time': 1774465883.853314, 'last_price_update_time': 1774674672.215783}
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UU65627') HTTP/1.1" 204 0
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-28 05:11:12 [auto1.nl] INFO: Scrape type for FA26024: 0
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-28 05:11:12 [auto1.nl] INFO: Scrape type for ZY88945: 0
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-28 05:11:12 [auto1.nl] INFO: Scrape type for BX68417: 0
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-28 05:11:12 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY95005%27 HTTP/1.1" 200 None
2026-03-28 05:11:12 [auto1.nl] INFO: Scrape type for NY95005: 0
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-28 05:11:12 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-28 05:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:13 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:13 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-28 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY33770%27 HTTP/1.1" 200 None
2026-03-28 05:11:13 [auto1.nl] INFO: Scrape type for BY33770: 2
2026-03-28 05:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9650a856-053e-5e82-b408-67b16763f030 with identifier: BY33770
2026-03-28 05:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9650a856-053e-5e82-b408-67b16763f030 with scrape type 2
2026-03-28 05:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9650a856-053e-5e82-b408-67b16763f030 with scrape type 2
2026-03-28 05:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9650a856-053e-5e82-b408-67b16763f030, identifier: BY33770
2026-03-28 05:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9650a856-053e-5e82-b408-67b16763f030 with identifier: BY33770
2026-03-28 05:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9650a856-053e-5e82-b408-67b16763f030 with identifier: BY33770
2026-03-28 05:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9650a856-053e-5e82-b408-67b16763f030 with identifier: BY33770 to the API
2026-03-28 05:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:03Z',
 'fuel_type': 'petrol',
 'id': '9650a856-053e-5e82-b408-67b16763f030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY33770',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 167826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-09',
 'seller_name': None,
 'title': 'Honda Civic 1.8 VTEC Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2008}
2026-03-28 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY33770%27 HTTP/1.1" 200 None
2026-03-28 05:11:13 [auto1.nl] INFO: Saving data for BY33770: {'auction_closing_time': 1774716483.0, 'created_time': 1774552358.66427, 'last_price_update_time': 1774674673.898601}
2026-03-28 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY33770') HTTP/1.1" 204 0
2026-03-28 05:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Scrape type for RT17278: 2
2026-03-28 05:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with identifier: RT17278
2026-03-28 05:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with scrape type 2
2026-03-28 05:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with scrape type 2
2026-03-28 05:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee, identifier: RT17278
2026-03-28 05:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with identifier: RT17278
2026-03-28 05:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with identifier: RT17278
2026-03-28 05:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with identifier: RT17278 to the API
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:07:50Z',
 'fuel_type': 'diesel',
 'id': '5bdd6d3b-b1d5-563a-851e-29c1f4c43bee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT17278',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 97000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE Luxury',
 'transmission': 'automatic',
 'trim': 'HSE Luxury',
 'year': 2015}
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Saving data for RT17278: {'auction_closing_time': 1774714070.0, 'created_time': 1774552309.48014, 'last_price_update_time': 1774674674.416317}
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT17278') HTTP/1.1" 204 0
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE36776%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Scrape type for YE36776: 0
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Scrape type for CT01963: 0
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS92650%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Scrape type for TS92650: 0
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-28 05:11:14 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW78376%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Scrape type for YW78376: 2
2026-03-28 05:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7688ec-dc76-5c55-84cf-3bf2b7739f09 with identifier: YW78376
2026-03-28 05:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7688ec-dc76-5c55-84cf-3bf2b7739f09 with scrape type 2
2026-03-28 05:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a7688ec-dc76-5c55-84cf-3bf2b7739f09 with scrape type 2
2026-03-28 05:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2a7688ec-dc76-5c55-84cf-3bf2b7739f09, identifier: YW78376
2026-03-28 05:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2a7688ec-dc76-5c55-84cf-3bf2b7739f09 with identifier: YW78376
2026-03-28 05:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2a7688ec-dc76-5c55-84cf-3bf2b7739f09 with identifier: YW78376
2026-03-28 05:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2a7688ec-dc76-5c55-84cf-3bf2b7739f09 with identifier: YW78376 to the API
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:17:03Z',
 'fuel_type': 'petrol',
 'id': '2a7688ec-dc76-5c55-84cf-3bf2b7739f09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW78376',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 353234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-07',
 'seller_name': None,
 'title': 'Volvo XC90 2.9 T6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2004}
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW78376%27 HTTP/1.1" 200 None
2026-03-28 05:11:14 [auto1.nl] INFO: Saving data for YW78376: {'auction_closing_time': 1774714623.0, 'created_time': 1774465971.786082, 'last_price_update_time': 1774674674.955423}
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YW78376') HTTP/1.1" 204 0
2026-03-28 05:11:15 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 05:11:15 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW41282%27 HTTP/1.1" 200 None
2026-03-28 05:11:15 [auto1.nl] INFO: Scrape type for SW41282: 2
2026-03-28 05:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587e009a-ab87-5183-b21c-bf3bb7d2742e with identifier: SW41282
2026-03-28 05:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587e009a-ab87-5183-b21c-bf3bb7d2742e with scrape type 2
2026-03-28 05:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587e009a-ab87-5183-b21c-bf3bb7d2742e with scrape type 2
2026-03-28 05:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 587e009a-ab87-5183-b21c-bf3bb7d2742e, identifier: SW41282
2026-03-28 05:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 587e009a-ab87-5183-b21c-bf3bb7d2742e with identifier: SW41282
2026-03-28 05:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 587e009a-ab87-5183-b21c-bf3bb7d2742e with identifier: SW41282
2026-03-28 05:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 587e009a-ab87-5183-b21c-bf3bb7d2742e with identifier: SW41282 to the API
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:27Z',
 'fuel_type': 'diesel',
 'id': '587e009a-ab87-5183-b21c-bf3bb7d2742e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW41282',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 301006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-18',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 HDi Business-Line',
 'transmission': 'automatic',
 'trim': 'Business-Line',
 'year': 2012}
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW41282%27 HTTP/1.1" 200 None
2026-03-28 05:11:15 [auto1.nl] INFO: Saving data for SW41282: {'auction_closing_time': 1774714707.0, 'created_time': 1774354454.531594, 'last_price_update_time': 1774674675.472837}
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SW41282') HTTP/1.1" 204 0
2026-03-28 05:11:15 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-28 05:11:15 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ22600%27 HTTP/1.1" 200 None
2026-03-28 05:11:15 [auto1.nl] INFO: Scrape type for PZ22600: 2
2026-03-28 05:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e2fe50-3394-5050-b2a2-ada7e901879a with identifier: PZ22600
2026-03-28 05:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e2fe50-3394-5050-b2a2-ada7e901879a with scrape type 2
2026-03-28 05:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e2fe50-3394-5050-b2a2-ada7e901879a with scrape type 2
2026-03-28 05:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56e2fe50-3394-5050-b2a2-ada7e901879a, identifier: PZ22600
2026-03-28 05:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56e2fe50-3394-5050-b2a2-ada7e901879a with identifier: PZ22600
2026-03-28 05:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56e2fe50-3394-5050-b2a2-ada7e901879a with identifier: PZ22600
2026-03-28 05:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56e2fe50-3394-5050-b2a2-ada7e901879a with identifier: PZ22600 to the API
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:35:40Z',
 'fuel_type': 'petrol',
 'id': '56e2fe50-3394-5050-b2a2-ada7e901879a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ22600',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 115125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-23',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2008}
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ22600%27 HTTP/1.1" 200 None
2026-03-28 05:11:15 [auto1.nl] INFO: Saving data for PZ22600: {'auction_closing_time': 1774715740.0, 'created_time': 1774465903.463686, 'last_price_update_time': 1774674675.891613}
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PZ22600') HTTP/1.1" 204 0
2026-03-28 05:11:15 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-28 05:11:15 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN28689%27 HTTP/1.1" 200 None
2026-03-28 05:11:15 [auto1.nl] INFO: Scrape type for BN28689: 2
2026-03-28 05:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a903a56b-2185-51a4-b667-b8b391038a23 with identifier: BN28689
2026-03-28 05:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a903a56b-2185-51a4-b667-b8b391038a23 with scrape type 2
2026-03-28 05:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a903a56b-2185-51a4-b667-b8b391038a23 with scrape type 2
2026-03-28 05:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a903a56b-2185-51a4-b667-b8b391038a23, identifier: BN28689
2026-03-28 05:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a903a56b-2185-51a4-b667-b8b391038a23 with identifier: BN28689
2026-03-28 05:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a903a56b-2185-51a4-b667-b8b391038a23 with identifier: BN28689
2026-03-28 05:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a903a56b-2185-51a4-b667-b8b391038a23 with identifier: BN28689 to the API
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:53:06Z',
 'fuel_type': 'petrol',
 'id': 'a903a56b-2185-51a4-b667-b8b391038a23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN28689',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 153817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-07',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN28689%27 HTTP/1.1" 200 None
2026-03-28 05:11:16 [auto1.nl] INFO: Saving data for BN28689: {'auction_closing_time': 1774716786.0, 'created_time': 1774465998.409795, 'last_price_update_time': 1774674676.296016}
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN28689') HTTP/1.1" 204 0
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-28 05:11:16 [auto1.nl] INFO: Scrape type for MD57319: 0
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-28 05:11:16 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK48888%27 HTTP/1.1" 200 None
2026-03-28 05:11:16 [auto1.nl] INFO: Scrape type for CK48888: 0
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-28 05:11:16 [auto1.nl] INFO: Scrape type for GD99184: 0
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV32142%27 HTTP/1.1" 200 None
2026-03-28 05:11:16 [auto1.nl] INFO: Scrape type for WV32142: 2
2026-03-28 05:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24672ac1-45dd-53bf-b1e4-7e06043d749a with identifier: WV32142
2026-03-28 05:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24672ac1-45dd-53bf-b1e4-7e06043d749a with scrape type 2
2026-03-28 05:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24672ac1-45dd-53bf-b1e4-7e06043d749a with scrape type 2
2026-03-28 05:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 24672ac1-45dd-53bf-b1e4-7e06043d749a, identifier: WV32142
2026-03-28 05:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 24672ac1-45dd-53bf-b1e4-7e06043d749a with identifier: WV32142
2026-03-28 05:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 24672ac1-45dd-53bf-b1e4-7e06043d749a with identifier: WV32142
2026-03-28 05:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 24672ac1-45dd-53bf-b1e4-7e06043d749a with identifier: WV32142 to the API
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:17:42Z',
 'fuel_type': 'diesel',
 'id': '24672ac1-45dd-53bf-b1e4-7e06043d749a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV32142',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 252636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-02',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2014}
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV32142%27 HTTP/1.1" 200 None
2026-03-28 05:11:16 [auto1.nl] INFO: Saving data for WV32142: {'auction_closing_time': 1774714662.0, 'created_time': 1774465857.813387, 'last_price_update_time': 1774674676.846029}
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WV32142') HTTP/1.1" 204 0
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-28 05:11:16 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-28 05:11:16 [auto1.nl] INFO: Scrape type for DU88284: 2
2026-03-28 05:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4349fa8f-f460-5934-a538-5d108c7270ba with identifier: DU88284
2026-03-28 05:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4349fa8f-f460-5934-a538-5d108c7270ba with scrape type 2
2026-03-28 05:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4349fa8f-f460-5934-a538-5d108c7270ba with scrape type 2
2026-03-28 05:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4349fa8f-f460-5934-a538-5d108c7270ba, identifier: DU88284
2026-03-28 05:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4349fa8f-f460-5934-a538-5d108c7270ba with identifier: DU88284
2026-03-28 05:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4349fa8f-f460-5934-a538-5d108c7270ba with identifier: DU88284
2026-03-28 05:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4349fa8f-f460-5934-a538-5d108c7270ba with identifier: DU88284 to the API
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:27:45Z',
 'fuel_type': 'petrol',
 'id': '4349fa8f-f460-5934-a538-5d108c7270ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU88284',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 65806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-28 05:11:17 [auto1.nl] INFO: Saving data for DU88284: {'auction_closing_time': 1774715265.0, 'created_time': 1774552333.362678, 'last_price_update_time': 1774674677.352822}
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU88284') HTTP/1.1" 204 0
2026-03-28 05:11:17 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-28 05:11:17 [auto1.nl] INFO: Scrape type for WC97739: 0
2026-03-28 05:11:17 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC21923%27 HTTP/1.1" 200 None
2026-03-28 05:11:17 [auto1.nl] INFO: Scrape type for MC21923: 0
2026-03-28 05:11:17 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-28 05:11:17 [auto1.nl] INFO: Scrape type for ZL38920: 2
2026-03-28 05:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-28 05:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with scrape type 2
2026-03-28 05:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with scrape type 2
2026-03-28 05:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e, identifier: ZL38920
2026-03-28 05:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-28 05:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-28 05:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920 to the API
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:32:50Z',
 'fuel_type': 'petrol',
 'id': 'd7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL38920',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 132275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-10',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2019}
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-28 05:11:17 [auto1.nl] INFO: Saving data for ZL38920: {'auction_closing_time': 1774715570.0, 'created_time': 1773232252.95277, 'last_price_update_time': 1774674677.855821}
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL38920') HTTP/1.1" 204 0
2026-03-28 05:11:17 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK82229%27 HTTP/1.1" 200 None
2026-03-28 05:11:17 [auto1.nl] INFO: Scrape type for AK82229: 2
2026-03-28 05:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e4ad64-7efd-577f-beae-69602f46dcfc with identifier: AK82229
2026-03-28 05:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e4ad64-7efd-577f-beae-69602f46dcfc with scrape type 2
2026-03-28 05:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59e4ad64-7efd-577f-beae-69602f46dcfc with scrape type 2
2026-03-28 05:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 59e4ad64-7efd-577f-beae-69602f46dcfc, identifier: AK82229
2026-03-28 05:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 59e4ad64-7efd-577f-beae-69602f46dcfc with identifier: AK82229
2026-03-28 05:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 59e4ad64-7efd-577f-beae-69602f46dcfc with identifier: AK82229
2026-03-28 05:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 59e4ad64-7efd-577f-beae-69602f46dcfc with identifier: AK82229 to the API
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-28T16:05:50Z',
 'fuel_type': 'petrol',
 'id': '59e4ad64-7efd-577f-beae-69602f46dcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK82229',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 76205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Tekna+',
 'transmission': 'manual',
 'trim': 'Tekna+',
 'year': 2019}
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK82229%27 HTTP/1.1" 200 None
2026-03-28 05:11:18 [auto1.nl] INFO: Saving data for AK82229: {'auction_closing_time': 1774713950.0, 'created_time': 1774465897.605691, 'last_price_update_time': 1774674678.281275}
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AK82229') HTTP/1.1" 204 0
2026-03-28 05:11:18 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD16016%27 HTTP/1.1" 200 None
2026-03-28 05:11:18 [auto1.nl] INFO: Scrape type for FD16016: 2
2026-03-28 05:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8831183-fc14-5cdb-95d4-1de090f3cc6e with identifier: FD16016
2026-03-28 05:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8831183-fc14-5cdb-95d4-1de090f3cc6e with scrape type 2
2026-03-28 05:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8831183-fc14-5cdb-95d4-1de090f3cc6e with scrape type 2
2026-03-28 05:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d8831183-fc14-5cdb-95d4-1de090f3cc6e, identifier: FD16016
2026-03-28 05:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d8831183-fc14-5cdb-95d4-1de090f3cc6e with identifier: FD16016
2026-03-28 05:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d8831183-fc14-5cdb-95d4-1de090f3cc6e with identifier: FD16016
2026-03-28 05:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d8831183-fc14-5cdb-95d4-1de090f3cc6e with identifier: FD16016 to the API
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:04Z',
 'fuel_type': 'petrol',
 'id': 'd8831183-fc14-5cdb-95d4-1de090f3cc6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD16016',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 236260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-03',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T3 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2012}
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD16016%27 HTTP/1.1" 200 None
2026-03-28 05:11:18 [auto1.nl] INFO: Saving data for FD16016: {'auction_closing_time': 1774715584.0, 'created_time': 1774465966.585786, 'last_price_update_time': 1774674678.689367}
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD16016') HTTP/1.1" 204 0
2026-03-28 05:11:18 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:18 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX54730%27 HTTP/1.1" 200 None
2026-03-28 05:11:18 [auto1.nl] INFO: Scrape type for NX54730: 2
2026-03-28 05:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 378c0604-517b-5ef5-ae63-766ddaf9b10e with identifier: NX54730
2026-03-28 05:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 378c0604-517b-5ef5-ae63-766ddaf9b10e with scrape type 2
2026-03-28 05:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 378c0604-517b-5ef5-ae63-766ddaf9b10e with scrape type 2
2026-03-28 05:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 378c0604-517b-5ef5-ae63-766ddaf9b10e, identifier: NX54730
2026-03-28 05:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 378c0604-517b-5ef5-ae63-766ddaf9b10e with identifier: NX54730
2026-03-28 05:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 378c0604-517b-5ef5-ae63-766ddaf9b10e with identifier: NX54730
2026-03-28 05:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 378c0604-517b-5ef5-ae63-766ddaf9b10e with identifier: NX54730 to the API
2026-03-28 05:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:06:37Z',
 'fuel_type': 'petrol',
 'id': '378c0604-517b-5ef5-ae63-766ddaf9b10e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX54730',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 190974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-09',
 'seller_name': None,
 'title': 'BMW X3 2.5i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX54730%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Saving data for NX54730: {'auction_closing_time': 1774713997.0, 'created_time': 1774465856.833676, 'last_price_update_time': 1774674679.148464}
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX54730') HTTP/1.1" 204 0
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92567%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Scrape type for UU92567: 2
2026-03-28 05:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 174fd2f1-12e9-5e9b-9a51-2ebf394fcc21 with identifier: UU92567
2026-03-28 05:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 174fd2f1-12e9-5e9b-9a51-2ebf394fcc21 with scrape type 2
2026-03-28 05:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 174fd2f1-12e9-5e9b-9a51-2ebf394fcc21 with scrape type 2
2026-03-28 05:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 174fd2f1-12e9-5e9b-9a51-2ebf394fcc21, identifier: UU92567
2026-03-28 05:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ22754%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Scrape type for HZ22754: 0
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC55354%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Scrape type for FC55354: 0
2026-03-28 05:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 174fd2f1-12e9-5e9b-9a51-2ebf394fcc21 with identifier: UU92567
2026-03-28 05:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 174fd2f1-12e9-5e9b-9a51-2ebf394fcc21 with identifier: UU92567
2026-03-28 05:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 174fd2f1-12e9-5e9b-9a51-2ebf394fcc21 with identifier: UU92567 to the API
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:42:13Z',
 'fuel_type': 'petrol',
 'id': '174fd2f1-12e9-5e9b-9a51-2ebf394fcc21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU92567',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 246364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92567%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Saving data for UU92567: {'auction_closing_time': 1774716133.0, 'created_time': 1774552344.658246, 'last_price_update_time': 1774674679.610838}
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UU92567') HTTP/1.1" 204 0
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD69435%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Scrape type for SD69435: 0
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD75991%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Scrape type for LD75991: 0
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Scrape type for CL54405: 0
2026-03-28 05:11:19 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ31369%27 HTTP/1.1" 200 None
2026-03-28 05:11:19 [auto1.nl] INFO: Scrape type for CJ31369: 2
2026-03-28 05:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e2749c7-2f07-5ddb-83e3-b5c38d659d92 with identifier: CJ31369
2026-03-28 05:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2749c7-2f07-5ddb-83e3-b5c38d659d92 with scrape type 2
2026-03-28 05:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e2749c7-2f07-5ddb-83e3-b5c38d659d92 with scrape type 2
2026-03-28 05:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6e2749c7-2f07-5ddb-83e3-b5c38d659d92, identifier: CJ31369
2026-03-28 05:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6e2749c7-2f07-5ddb-83e3-b5c38d659d92 with identifier: CJ31369
2026-03-28 05:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6e2749c7-2f07-5ddb-83e3-b5c38d659d92 with identifier: CJ31369
2026-03-28 05:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6e2749c7-2f07-5ddb-83e3-b5c38d659d92 with identifier: CJ31369 to the API
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:33:31Z',
 'fuel_type': 'petrol',
 'id': '6e2749c7-2f07-5ddb-83e3-b5c38d659d92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ31369',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 170143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-05',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.4 TCe Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ31369%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Saving data for CJ31369: {'auction_closing_time': 1774715611.0, 'created_time': 1774465992.054914, 'last_price_update_time': 1774674680.244949}
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ31369') HTTP/1.1" 204 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: WV84251
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for MD55137: 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for ZE21436: 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for TU57635: 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ77908%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for LJ77908: 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS89780%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for GS89780: 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA86988%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for VA86988: 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD32446%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for XD32446: 2
2026-03-28 05:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1c42818-8beb-5d6b-8786-659e76516e96 with identifier: XD32446
2026-03-28 05:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c42818-8beb-5d6b-8786-659e76516e96 with scrape type 2
2026-03-28 05:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1c42818-8beb-5d6b-8786-659e76516e96 with scrape type 2
2026-03-28 05:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1c42818-8beb-5d6b-8786-659e76516e96, identifier: XD32446
2026-03-28 05:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1c42818-8beb-5d6b-8786-659e76516e96 with identifier: XD32446
2026-03-28 05:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1c42818-8beb-5d6b-8786-659e76516e96 with identifier: XD32446
2026-03-28 05:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1c42818-8beb-5d6b-8786-659e76516e96 with identifier: XD32446 to the API
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:12:26Z',
 'fuel_type': 'petrol',
 'id': 'a1c42818-8beb-5d6b-8786-659e76516e96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD32446',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 108327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-27',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2011}
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD32446%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Saving data for XD32446: {'auction_closing_time': 1774714346.0, 'created_time': 1774552324.036653, 'last_price_update_time': 1774674680.76335}
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XD32446') HTTP/1.1" 204 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XB72700%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for XB72700: 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX44669%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for AX44669: 0
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-28 05:11:20 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV41758%27 HTTP/1.1" 200 None
2026-03-28 05:11:20 [auto1.nl] INFO: Scrape type for XV41758: 2
2026-03-28 05:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bb23897-3013-569c-ad3a-7c130a95c43a with identifier: XV41758
2026-03-28 05:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bb23897-3013-569c-ad3a-7c130a95c43a with scrape type 2
2026-03-28 05:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bb23897-3013-569c-ad3a-7c130a95c43a with scrape type 2
2026-03-28 05:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4bb23897-3013-569c-ad3a-7c130a95c43a, identifier: XV41758
2026-03-28 05:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4bb23897-3013-569c-ad3a-7c130a95c43a with identifier: XV41758
2026-03-28 05:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4bb23897-3013-569c-ad3a-7c130a95c43a with identifier: XV41758
2026-03-28 05:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4bb23897-3013-569c-ad3a-7c130a95c43a with identifier: XV41758 to the API
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:58:08Z',
 'fuel_type': 'petrol',
 'id': '4bb23897-3013-569c-ad3a-7c130a95c43a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV41758',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 115334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV41758%27 HTTP/1.1" 200 None
2026-03-28 05:11:21 [auto1.nl] INFO: Saving data for XV41758: {'auction_closing_time': 1774717088.0, 'created_time': 1774465978.721524, 'last_price_update_time': 1774674681.306519}
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV41758') HTTP/1.1" 204 0
2026-03-28 05:11:21 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-28 05:11:21 [auto1.nl] INFO: Scrape type for VL80205: 0
2026-03-28 05:11:21 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN49901%27 HTTP/1.1" 200 None
2026-03-28 05:11:21 [auto1.nl] INFO: Scrape type for PN49901: 2
2026-03-28 05:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b73c06b-023d-546c-a5e1-c6067e0cd173 with identifier: PN49901
2026-03-28 05:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b73c06b-023d-546c-a5e1-c6067e0cd173 with scrape type 2
2026-03-28 05:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b73c06b-023d-546c-a5e1-c6067e0cd173 with scrape type 2
2026-03-28 05:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0b73c06b-023d-546c-a5e1-c6067e0cd173, identifier: PN49901
2026-03-28 05:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0b73c06b-023d-546c-a5e1-c6067e0cd173 with identifier: PN49901
2026-03-28 05:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0b73c06b-023d-546c-a5e1-c6067e0cd173 with identifier: PN49901
2026-03-28 05:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0b73c06b-023d-546c-a5e1-c6067e0cd173 with identifier: PN49901 to the API
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-28T16:08:13Z',
 'fuel_type': 'petrol',
 'id': '0b73c06b-023d-546c-a5e1-c6067e0cd173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN49901',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 51634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-28',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN49901%27 HTTP/1.1" 200 None
2026-03-28 05:11:21 [auto1.nl] INFO: Saving data for PN49901: {'auction_closing_time': 1774714093.0, 'created_time': 1773836729.560442, 'last_price_update_time': 1774674681.725116}
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PN49901') HTTP/1.1" 204 0
2026-03-28 05:11:21 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-28 05:11:21 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA98443%27 HTTP/1.1" 200 None
2026-03-28 05:11:21 [auto1.nl] INFO: Scrape type for WA98443: 0
2026-03-28 05:11:21 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-28 05:11:21 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-28 05:11:21 [auto1.nl] INFO: Scrape type for RJ32742: 2
2026-03-28 05:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with identifier: RJ32742
2026-03-28 05:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with scrape type 2
2026-03-28 05:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with scrape type 2
2026-03-28 05:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4, identifier: RJ32742
2026-03-28 05:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with identifier: RJ32742
2026-03-28 05:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with identifier: RJ32742
2026-03-28 05:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with identifier: RJ32742 to the API
2026-03-28 05:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:13:53Z',
 'fuel_type': 'diesel',
 'id': '283c78cb-1235-5e9a-ad6e-38c256a3b7d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ32742',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 California',
 'odometer': 437114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-08-03',
 'seller_name': None,
 'title': 'Volkswagen T4 California 2.4 Diesel Aufstelldach',
 'transmission': 'manual',
 'trim': 'Aufstelldach',
 'year': 1992}
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-28 05:11:22 [auto1.nl] INFO: Saving data for RJ32742: {'auction_closing_time': 1774714433.0, 'created_time': 1774552353.813621, 'last_price_update_time': 1774674682.167053}
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RJ32742') HTTP/1.1" 204 0
2026-03-28 05:11:22 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-28 05:11:22 [auto1.nl] INFO: Scrape type for LC20908: 0
2026-03-28 05:11:22 [auto1.nl] INFO: Found listing with ID: GJ08711
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ08711%27 HTTP/1.1" 200 None
2026-03-28 05:11:22 [auto1.nl] INFO: Scrape type for GJ08711: 0
2026-03-28 05:11:22 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-28 05:11:22 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-28 05:11:22 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-28 05:11:22 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-28 05:11:22 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD05711%27 HTTP/1.1" 200 None
2026-03-28 05:11:22 [auto1.nl] INFO: Scrape type for TD05711: 0
2026-03-28 05:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:23 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:23 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-28 05:11:23 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV28211%27 HTTP/1.1" 200 None
2026-03-28 05:11:23 [auto1.nl] INFO: Scrape type for TV28211: 2
2026-03-28 05:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76160c4-927c-58e6-a33f-a3d5785c5d98 with identifier: TV28211
2026-03-28 05:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76160c4-927c-58e6-a33f-a3d5785c5d98 with scrape type 2
2026-03-28 05:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a76160c4-927c-58e6-a33f-a3d5785c5d98 with scrape type 2
2026-03-28 05:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a76160c4-927c-58e6-a33f-a3d5785c5d98, identifier: TV28211
2026-03-28 05:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a76160c4-927c-58e6-a33f-a3d5785c5d98 with identifier: TV28211
2026-03-28 05:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a76160c4-927c-58e6-a33f-a3d5785c5d98 with identifier: TV28211
2026-03-28 05:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a76160c4-927c-58e6-a33f-a3d5785c5d98 with identifier: TV28211 to the API
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:11:55Z',
 'fuel_type': 'petrol',
 'id': 'a76160c4-927c-58e6-a33f-a3d5785c5d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV28211',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 172710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-19',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2014}
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV28211%27 HTTP/1.1" 200 None
2026-03-28 05:11:23 [auto1.nl] INFO: Saving data for TV28211: {'auction_closing_time': 1774714315.0, 'created_time': 1773343072.539707, 'last_price_update_time': 1774674683.668201}
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TV28211') HTTP/1.1" 204 0
2026-03-28 05:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:11:23 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB61734%27 HTTP/1.1" 200 None
2026-03-28 05:11:23 [auto1.nl] INFO: Scrape type for NB61734: 2
2026-03-28 05:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd8029ab-37f1-5ad8-941d-93781971ec03 with identifier: NB61734
2026-03-28 05:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd8029ab-37f1-5ad8-941d-93781971ec03 with scrape type 2
2026-03-28 05:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd8029ab-37f1-5ad8-941d-93781971ec03 with scrape type 2
2026-03-28 05:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bd8029ab-37f1-5ad8-941d-93781971ec03, identifier: NB61734
2026-03-28 05:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bd8029ab-37f1-5ad8-941d-93781971ec03 with identifier: NB61734
2026-03-28 05:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bd8029ab-37f1-5ad8-941d-93781971ec03 with identifier: NB61734
2026-03-28 05:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bd8029ab-37f1-5ad8-941d-93781971ec03 with identifier: NB61734 to the API
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:01:41Z',
 'fuel_type': 'diesel',
 'id': 'bd8029ab-37f1-5ad8-941d-93781971ec03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB61734',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 204255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-28',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Summum 2WD',
 'transmission': 'automatic',
 'trim': 'Summum 2WD',
 'year': 2014}
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB61734%27 HTTP/1.1" 200 None
2026-03-28 05:11:24 [auto1.nl] INFO: Saving data for NB61734: {'auction_closing_time': 1774713701.0, 'created_time': 1774465995.021886, 'last_price_update_time': 1774674684.073761}
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NB61734') HTTP/1.1" 204 0
2026-03-28 05:11:24 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-28 05:11:24 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP69884%27 HTTP/1.1" 200 None
2026-03-28 05:11:24 [auto1.nl] INFO: Scrape type for RP69884: 2
2026-03-28 05:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e00552d-b25c-5f2f-920e-202b44b271da with identifier: RP69884
2026-03-28 05:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e00552d-b25c-5f2f-920e-202b44b271da with scrape type 2
2026-03-28 05:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e00552d-b25c-5f2f-920e-202b44b271da with scrape type 2
2026-03-28 05:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4e00552d-b25c-5f2f-920e-202b44b271da, identifier: RP69884
2026-03-28 05:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4e00552d-b25c-5f2f-920e-202b44b271da with identifier: RP69884
2026-03-28 05:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4e00552d-b25c-5f2f-920e-202b44b271da with identifier: RP69884
2026-03-28 05:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4e00552d-b25c-5f2f-920e-202b44b271da with identifier: RP69884 to the API
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:38Z',
 'fuel_type': 'petrol',
 'id': '4e00552d-b25c-5f2f-920e-202b44b271da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP69884',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 298414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion',
 'year': 2010}
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP69884%27 HTTP/1.1" 200 None
2026-03-28 05:11:24 [auto1.nl] INFO: Saving data for RP69884: {'auction_closing_time': 1774716278.0, 'created_time': 1774465850.319991, 'last_price_update_time': 1774674684.497695}
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RP69884') HTTP/1.1" 204 0
2026-03-28 05:11:24 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-28 05:11:24 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-28 05:11:24 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-28 05:11:24 [auto1.nl] INFO: Scrape type for VL52985: 2
2026-03-28 05:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-28 05:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b50388c-81a6-5005-86ae-e904bf073f82 with scrape type 2
2026-03-28 05:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b50388c-81a6-5005-86ae-e904bf073f82 with scrape type 2
2026-03-28 05:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b50388c-81a6-5005-86ae-e904bf073f82, identifier: VL52985
2026-03-28 05:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-28 05:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-28 05:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985 to the API
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:20:57Z',
 'fuel_type': 'petrol',
 'id': '2b50388c-81a6-5005-86ae-e904bf073f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL52985',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 182503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-05',
 'seller_name': None,
 'title': 'Kia Venga 1.6 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2012}
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-28 05:11:25 [auto1.nl] INFO: Saving data for VL52985: {'auction_closing_time': 1774714857.0, 'created_time': 1773342980.661633, 'last_price_update_time': 1774674685.036936}
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL52985') HTTP/1.1" 204 0
2026-03-28 05:11:25 [auto1.nl] INFO: Found listing with ID: EL39193
2026-03-28 05:11:25 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA16838%27 HTTP/1.1" 200 None
2026-03-28 05:11:25 [auto1.nl] INFO: Scrape type for BA16838: 2
2026-03-28 05:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ba16f0-11e3-5ca0-b6a0-a415d08cd4a4 with identifier: BA16838
2026-03-28 05:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ba16f0-11e3-5ca0-b6a0-a415d08cd4a4 with scrape type 2
2026-03-28 05:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47ba16f0-11e3-5ca0-b6a0-a415d08cd4a4 with scrape type 2
2026-03-28 05:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 47ba16f0-11e3-5ca0-b6a0-a415d08cd4a4, identifier: BA16838
2026-03-28 05:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 47ba16f0-11e3-5ca0-b6a0-a415d08cd4a4 with identifier: BA16838
2026-03-28 05:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 47ba16f0-11e3-5ca0-b6a0-a415d08cd4a4 with identifier: BA16838
2026-03-28 05:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 47ba16f0-11e3-5ca0-b6a0-a415d08cd4a4 with identifier: BA16838 to the API
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:53Z',
 'fuel_type': 'petrol',
 'id': '47ba16f0-11e3-5ca0-b6a0-a415d08cd4a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA16838',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 110740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-20',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2014}
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA16838%27 HTTP/1.1" 200 None
2026-03-28 05:11:25 [auto1.nl] INFO: Saving data for BA16838: {'auction_closing_time': 1774715213.0, 'created_time': 1774465917.163164, 'last_price_update_time': 1774674685.494682}
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BA16838') HTTP/1.1" 204 0
2026-03-28 05:11:25 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-28 05:11:25 [auto1.nl] INFO: Scrape type for SS31744: 0
2026-03-28 05:11:25 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-28 05:11:25 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-28 05:11:25 [auto1.nl] INFO: Scrape type for TP84646: 2
2026-03-28 05:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12414357-0885-5894-a8f5-27ee410c4b2e with identifier: TP84646
2026-03-28 05:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12414357-0885-5894-a8f5-27ee410c4b2e with scrape type 2
2026-03-28 05:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12414357-0885-5894-a8f5-27ee410c4b2e with scrape type 2
2026-03-28 05:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 12414357-0885-5894-a8f5-27ee410c4b2e, identifier: TP84646
2026-03-28 05:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 12414357-0885-5894-a8f5-27ee410c4b2e with identifier: TP84646
2026-03-28 05:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 12414357-0885-5894-a8f5-27ee410c4b2e with identifier: TP84646
2026-03-28 05:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 12414357-0885-5894-a8f5-27ee410c4b2e with identifier: TP84646 to the API
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:03:51Z',
 'fuel_type': 'hybrid',
 'id': '12414357-0885-5894-a8f5-27ee410c4b2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP84646',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 160762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-28 05:11:25 [auto1.nl] INFO: Saving data for TP84646: {'auction_closing_time': 1774713831.0, 'created_time': 1774552319.731164, 'last_price_update_time': 1774674685.948675}
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP84646') HTTP/1.1" 204 0
2026-03-28 05:11:25 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM20026%27 HTTP/1.1" 200 None
2026-03-28 05:11:25 [auto1.nl] INFO: Scrape type for RM20026: 2
2026-03-28 05:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13e4f25a-065b-5563-b85b-10d82fa1f9a1 with identifier: RM20026
2026-03-28 05:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13e4f25a-065b-5563-b85b-10d82fa1f9a1 with scrape type 2
2026-03-28 05:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13e4f25a-065b-5563-b85b-10d82fa1f9a1 with scrape type 2
2026-03-28 05:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 13e4f25a-065b-5563-b85b-10d82fa1f9a1, identifier: RM20026
2026-03-28 05:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 13e4f25a-065b-5563-b85b-10d82fa1f9a1 with identifier: RM20026
2026-03-28 05:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 13e4f25a-065b-5563-b85b-10d82fa1f9a1 with identifier: RM20026
2026-03-28 05:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 13e4f25a-065b-5563-b85b-10d82fa1f9a1 with identifier: RM20026 to the API
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:14:11Z',
 'fuel_type': 'petrol',
 'id': '13e4f25a-065b-5563-b85b-10d82fa1f9a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM20026',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 146589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-03',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM20026%27 HTTP/1.1" 200 None
2026-03-28 05:11:26 [auto1.nl] INFO: Saving data for RM20026: {'auction_closing_time': 1774714451.0, 'created_time': 1774465975.829944, 'last_price_update_time': 1774674686.382836}
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RM20026') HTTP/1.1" 204 0
2026-03-28 05:11:26 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX87704%27 HTTP/1.1" 200 None
2026-03-28 05:11:26 [auto1.nl] INFO: Scrape type for MX87704: 0
2026-03-28 05:11:26 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-28 05:11:26 [auto1.nl] INFO: Scrape type for KT95598: 2
2026-03-28 05:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a56da1-ec5b-574e-9bcb-3ba836d2a52b with identifier: KT95598
2026-03-28 05:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a56da1-ec5b-574e-9bcb-3ba836d2a52b with scrape type 2
2026-03-28 05:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65a56da1-ec5b-574e-9bcb-3ba836d2a52b with scrape type 2
2026-03-28 05:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 65a56da1-ec5b-574e-9bcb-3ba836d2a52b, identifier: KT95598
2026-03-28 05:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 65a56da1-ec5b-574e-9bcb-3ba836d2a52b with identifier: KT95598
2026-03-28 05:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 65a56da1-ec5b-574e-9bcb-3ba836d2a52b with identifier: KT95598
2026-03-28 05:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 65a56da1-ec5b-574e-9bcb-3ba836d2a52b with identifier: KT95598 to the API
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:50:32Z',
 'fuel_type': 'petrol',
 'id': '65a56da1-ec5b-574e-9bcb-3ba836d2a52b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT95598',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 118989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-31',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2017}
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-28 05:11:26 [auto1.nl] INFO: Saving data for KT95598: {'auction_closing_time': 1774716632.0, 'created_time': 1774552307.512836, 'last_price_update_time': 1774674686.853242}
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KT95598') HTTP/1.1" 204 0
2026-03-28 05:11:26 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-28 05:11:26 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-28 05:11:26 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-28 05:11:26 [auto1.nl] INFO: Scrape type for EG83115: 2
2026-03-28 05:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2906658-b1da-5fae-b8b1-64deb3da18eb with identifier: EG83115
2026-03-28 05:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2906658-b1da-5fae-b8b1-64deb3da18eb with scrape type 2
2026-03-28 05:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2906658-b1da-5fae-b8b1-64deb3da18eb with scrape type 2
2026-03-28 05:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2906658-b1da-5fae-b8b1-64deb3da18eb, identifier: EG83115
2026-03-28 05:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2906658-b1da-5fae-b8b1-64deb3da18eb with identifier: EG83115
2026-03-28 05:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2906658-b1da-5fae-b8b1-64deb3da18eb with identifier: EG83115
2026-03-28 05:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2906658-b1da-5fae-b8b1-64deb3da18eb with identifier: EG83115 to the API
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:19:16Z',
 'fuel_type': 'petrol',
 'id': 'f2906658-b1da-5fae-b8b1-64deb3da18eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG83115',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 285390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'automatic',
 'trim': 'Turismo',
 'year': 2013}
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-28 05:11:27 [auto1.nl] INFO: Saving data for EG83115: {'auction_closing_time': 1774714756.0, 'created_time': 1774552308.456859, 'last_price_update_time': 1774674687.412177}
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG83115') HTTP/1.1" 204 0
2026-03-28 05:11:27 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-28 05:11:27 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH98197%27 HTTP/1.1" 200 None
2026-03-28 05:11:27 [auto1.nl] INFO: Scrape type for EH98197: 2
2026-03-28 05:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec7c2416-0e43-5af1-8c75-83731f574c85 with identifier: EH98197
2026-03-28 05:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec7c2416-0e43-5af1-8c75-83731f574c85 with scrape type 2
2026-03-28 05:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec7c2416-0e43-5af1-8c75-83731f574c85 with scrape type 2
2026-03-28 05:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ec7c2416-0e43-5af1-8c75-83731f574c85, identifier: EH98197
2026-03-28 05:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ec7c2416-0e43-5af1-8c75-83731f574c85 with identifier: EH98197
2026-03-28 05:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ec7c2416-0e43-5af1-8c75-83731f574c85 with identifier: EH98197
2026-03-28 05:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ec7c2416-0e43-5af1-8c75-83731f574c85 with identifier: EH98197 to the API
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:29:45Z',
 'fuel_type': 'hybrid',
 'id': 'ec7c2416-0e43-5af1-8c75-83731f574c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH98197',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 32683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH98197%27 HTTP/1.1" 200 None
2026-03-28 05:11:27 [auto1.nl] INFO: Saving data for EH98197: {'auction_closing_time': 1774715385.0, 'created_time': 1774465988.030663, 'last_price_update_time': 1774674687.851539}
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH98197') HTTP/1.1" 204 0
2026-03-28 05:11:27 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-28 05:11:27 [auto1.nl] INFO: Scrape type for JZ35389: 0
2026-03-28 05:11:27 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG56616%27 HTTP/1.1" 200 None
2026-03-28 05:11:27 [auto1.nl] INFO: Scrape type for HG56616: 0
2026-03-28 05:11:27 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-28 05:11:27 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR89214%27 HTTP/1.1" 200 None
2026-03-28 05:11:27 [auto1.nl] INFO: Scrape type for MR89214: 0
2026-03-28 05:11:27 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-28 05:11:27 [auto1.nl] INFO: Scrape type for SG32295: 0
2026-03-28 05:11:27 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-28 05:11:27 [auto1.nl] INFO: Scrape type for TJ11018: 2
2026-03-28 05:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with identifier: TJ11018
2026-03-28 05:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with scrape type 2
2026-03-28 05:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with scrape type 2
2026-03-28 05:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69, identifier: TJ11018
2026-03-28 05:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with identifier: TJ11018
2026-03-28 05:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with identifier: TJ11018
2026-03-28 05:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with identifier: TJ11018 to the API
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:03:31Z',
 'fuel_type': 'petrol',
 'id': 'ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ11018',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 83742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-12',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-28 05:11:28 [auto1.nl] INFO: Saving data for TJ11018: {'auction_closing_time': 1774713811.0, 'created_time': 1774552355.526795, 'last_price_update_time': 1774674688.373064}
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TJ11018') HTTP/1.1" 204 0
2026-03-28 05:11:28 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:28 [auto1.nl] INFO: Found listing with ID: HL48318
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL48318%27 HTTP/1.1" 200 None
2026-03-28 05:11:28 [auto1.nl] INFO: Scrape type for HL48318: 0
2026-03-28 05:11:28 [auto1.nl] INFO: Found listing with ID: VN36525
2026-03-28 05:11:28 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC82380%27 HTTP/1.1" 200 None
2026-03-28 05:11:28 [auto1.nl] INFO: Scrape type for RC82380: 2
2026-03-28 05:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d76a878-cd44-54ff-9fa9-9e122c645c7c with identifier: RC82380
2026-03-28 05:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d76a878-cd44-54ff-9fa9-9e122c645c7c with scrape type 2
2026-03-28 05:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d76a878-cd44-54ff-9fa9-9e122c645c7c with scrape type 2
2026-03-28 05:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1d76a878-cd44-54ff-9fa9-9e122c645c7c, identifier: RC82380
2026-03-28 05:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1d76a878-cd44-54ff-9fa9-9e122c645c7c with identifier: RC82380
2026-03-28 05:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1d76a878-cd44-54ff-9fa9-9e122c645c7c with identifier: RC82380
2026-03-28 05:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1d76a878-cd44-54ff-9fa9-9e122c645c7c with identifier: RC82380 to the API
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:15:01Z',
 'fuel_type': 'diesel',
 'id': '1d76a878-cd44-54ff-9fa9-9e122c645c7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC82380',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 271483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2011}
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC82380%27 HTTP/1.1" 200 None
2026-03-28 05:11:28 [auto1.nl] INFO: Saving data for RC82380: {'auction_closing_time': 1774714501.0, 'created_time': 1774465888.694296, 'last_price_update_time': 1774674688.951984}
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC82380') HTTP/1.1" 204 0
2026-03-28 05:11:28 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UK83589%27 HTTP/1.1" 200 None
2026-03-28 05:11:28 [auto1.nl] INFO: Scrape type for UK83589: 2
2026-03-28 05:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e45865d-60db-5dd9-b28a-d9e5e186945c with identifier: UK83589
2026-03-28 05:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e45865d-60db-5dd9-b28a-d9e5e186945c with scrape type 2
2026-03-28 05:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e45865d-60db-5dd9-b28a-d9e5e186945c with scrape type 2
2026-03-28 05:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e45865d-60db-5dd9-b28a-d9e5e186945c, identifier: UK83589
2026-03-28 05:11:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Scrape type for JZ14599: 2
2026-03-28 05:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9586975-048f-583d-9fc5-1b03396a2cf9 with identifier: JZ14599
2026-03-28 05:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9586975-048f-583d-9fc5-1b03396a2cf9 with scrape type 2
2026-03-28 05:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9586975-048f-583d-9fc5-1b03396a2cf9 with scrape type 2
2026-03-28 05:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d9586975-048f-583d-9fc5-1b03396a2cf9, identifier: JZ14599
2026-03-28 05:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e45865d-60db-5dd9-b28a-d9e5e186945c with identifier: UK83589
2026-03-28 05:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e45865d-60db-5dd9-b28a-d9e5e186945c with identifier: UK83589
2026-03-28 05:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e45865d-60db-5dd9-b28a-d9e5e186945c with identifier: UK83589 to the API
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:00:54Z',
 'fuel_type': 'petrol',
 'id': '7e45865d-60db-5dd9-b28a-d9e5e186945c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK83589',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 27557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-12',
 'seller_name': None,
 'title': 'Nissan Note 1.2 N-Tec',
 'transmission': 'automatic',
 'trim': 'N-Tec',
 'year': 2015}
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UK83589%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Saving data for UK83589: {'auction_closing_time': 1774713654.0, 'created_time': 1774466006.343685, 'last_price_update_time': 1774674689.468791}
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UK83589') HTTP/1.1" 204 0
2026-03-28 05:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d9586975-048f-583d-9fc5-1b03396a2cf9 with identifier: JZ14599
2026-03-28 05:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d9586975-048f-583d-9fc5-1b03396a2cf9 with identifier: JZ14599
2026-03-28 05:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d9586975-048f-583d-9fc5-1b03396a2cf9 with identifier: JZ14599 to the API
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:36:56Z',
 'fuel_type': 'hybrid',
 'id': 'd9586975-048f-583d-9fc5-1b03396a2cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ14599',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 90038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-13',
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Pack',
 'transmission': 'automatic',
 'trim': 'Pack',
 'year': 2018}
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Saving data for JZ14599: {'auction_closing_time': 1774715816.0, 'created_time': 1774552357.203135, 'last_price_update_time': 1774674689.793792}
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JZ14599') HTTP/1.1" 204 0
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM82020%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Scrape type for JM82020: 0
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17699%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Scrape type for RT17699: 0
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Scrape type for NT73578: 0
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: ZP63957
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63957%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Scrape type for ZP63957: 0
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Scrape type for ZX00670: 0
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: NS77626
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS77626%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Scrape type for NS77626: 0
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-28 05:11:29 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA68002%27 HTTP/1.1" 200 None
2026-03-28 05:11:29 [auto1.nl] INFO: Scrape type for DA68002: 2
2026-03-28 05:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a7b8fd1-3a2a-5733-8f54-c31aeb6f6cf9 with identifier: DA68002
2026-03-28 05:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a7b8fd1-3a2a-5733-8f54-c31aeb6f6cf9 with scrape type 2
2026-03-28 05:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a7b8fd1-3a2a-5733-8f54-c31aeb6f6cf9 with scrape type 2
2026-03-28 05:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a7b8fd1-3a2a-5733-8f54-c31aeb6f6cf9, identifier: DA68002
2026-03-28 05:11:30 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-28 05:11:30 [auto1.nl] INFO: Scrape type for AX28541: 0
2026-03-28 05:11:30 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK31365%27 HTTP/1.1" 200 None
2026-03-28 05:11:30 [auto1.nl] INFO: Scrape type for KK31365: 2
2026-03-28 05:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d77c575-a347-5ac0-9ef4-2568aa31fdc8 with identifier: KK31365
2026-03-28 05:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d77c575-a347-5ac0-9ef4-2568aa31fdc8 with scrape type 2
2026-03-28 05:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d77c575-a347-5ac0-9ef4-2568aa31fdc8 with scrape type 2
2026-03-28 05:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8d77c575-a347-5ac0-9ef4-2568aa31fdc8, identifier: KK31365
2026-03-28 05:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a7b8fd1-3a2a-5733-8f54-c31aeb6f6cf9 with identifier: DA68002
2026-03-28 05:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a7b8fd1-3a2a-5733-8f54-c31aeb6f6cf9 with identifier: DA68002
2026-03-28 05:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a7b8fd1-3a2a-5733-8f54-c31aeb6f6cf9 with identifier: DA68002 to the API
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:07:59Z',
 'fuel_type': 'petrol',
 'id': '1a7b8fd1-3a2a-5733-8f54-c31aeb6f6cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA68002',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 325258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-11',
 'seller_name': None,
 'title': 'BMW 5er 528i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA68002%27 HTTP/1.1" 200 None
2026-03-28 05:11:30 [auto1.nl] INFO: Saving data for DA68002: {'auction_closing_time': 1774714079.0, 'created_time': 1774465860.54449, 'last_price_update_time': 1774674690.547196}
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA68002') HTTP/1.1" 204 0
2026-03-28 05:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8d77c575-a347-5ac0-9ef4-2568aa31fdc8 with identifier: KK31365
2026-03-28 05:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8d77c575-a347-5ac0-9ef4-2568aa31fdc8 with identifier: KK31365
2026-03-28 05:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8d77c575-a347-5ac0-9ef4-2568aa31fdc8 with identifier: KK31365 to the API
2026-03-28 05:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:10:49Z',
 'fuel_type': 'petrol',
 'id': '8d77c575-a347-5ac0-9ef4-2568aa31fdc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK31365',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 40696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': None,
 'title': 'Fiat 500C 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-03-28 05:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK31365%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Saving data for KK31365: {'auction_closing_time': 1774714249.0, 'created_time': 1773861140.942217, 'last_price_update_time': 1774674716.005551}
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KK31365') HTTP/1.1" 204 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: FH97185
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX15335%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for LX15335: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF13201%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for KF13201: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for FJ04475: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: NM87332
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM87332%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for NM87332: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN54197%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for MN54197: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW77077%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for VW77077: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN17461%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for JN17461: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: HC37182
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: CT04767
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for NS14796: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for BP47777: 0
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER73656%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for ER73656: 2
2026-03-28 05:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb93f17c-eb09-515c-8c29-f823e022c2e2 with identifier: ER73656
2026-03-28 05:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb93f17c-eb09-515c-8c29-f823e022c2e2 with scrape type 2
2026-03-28 05:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb93f17c-eb09-515c-8c29-f823e022c2e2 with scrape type 2
2026-03-28 05:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fb93f17c-eb09-515c-8c29-f823e022c2e2, identifier: ER73656
2026-03-28 05:11:56 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Scrape type for ZR40703: 2
2026-03-28 05:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbc36606-c0c2-5b69-81df-c5889e397f6d with identifier: ZR40703
2026-03-28 05:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbc36606-c0c2-5b69-81df-c5889e397f6d with scrape type 2
2026-03-28 05:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbc36606-c0c2-5b69-81df-c5889e397f6d with scrape type 2
2026-03-28 05:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cbc36606-c0c2-5b69-81df-c5889e397f6d, identifier: ZR40703
2026-03-28 05:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fb93f17c-eb09-515c-8c29-f823e022c2e2 with identifier: ER73656
2026-03-28 05:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fb93f17c-eb09-515c-8c29-f823e022c2e2 with identifier: ER73656
2026-03-28 05:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fb93f17c-eb09-515c-8c29-f823e022c2e2 with identifier: ER73656 to the API
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:27:25Z',
 'fuel_type': 'diesel',
 'id': 'fb93f17c-eb09-515c-8c29-f823e022c2e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER73656',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 285399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-29',
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2013}
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER73656%27 HTTP/1.1" 200 None
2026-03-28 05:11:56 [auto1.nl] INFO: Saving data for ER73656: {'auction_closing_time': 1774715245.0, 'created_time': 1774465862.744068, 'last_price_update_time': 1774674716.732281}
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ER73656') HTTP/1.1" 204 0
2026-03-28 05:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cbc36606-c0c2-5b69-81df-c5889e397f6d with identifier: ZR40703
2026-03-28 05:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cbc36606-c0c2-5b69-81df-c5889e397f6d with identifier: ZR40703
2026-03-28 05:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cbc36606-c0c2-5b69-81df-c5889e397f6d with identifier: ZR40703 to the API
2026-03-28 05:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:26Z',
 'fuel_type': 'petrol',
 'id': 'cbc36606-c0c2-5b69-81df-c5889e397f6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR40703',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 94562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-29',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Saving data for ZR40703: {'auction_closing_time': 1774716626.0, 'created_time': 1774552355.844759, 'last_price_update_time': 1774674717.126548}
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR40703') HTTP/1.1" 204 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22652%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for SV22652: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: NM97362
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM97362%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for NM97362: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for LE78061: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for MD18353: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for JL68792: 0
2026-03-28 05:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:57 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: LZ58703
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: WB40041
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for FJ96412: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: VH11794
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16720%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for HT16720: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: XC91044
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC91044%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for XC91044: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: CM13419
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM13419%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for CM13419: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: EX83153
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: DL78347
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL78347%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for DL78347: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: DX59899
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ17993%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for EJ17993: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: WS72354
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for FD56899: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for AW61305: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL82021%27 HTTP/1.1" 200 None
2026-03-28 05:11:57 [auto1.nl] INFO: Scrape type for NL82021: 0
2026-03-28 05:11:57 [auto1.nl] INFO: Found listing with ID: RD71224
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD71224%27 HTTP/1.1" 200 None
2026-03-28 05:11:58 [auto1.nl] INFO: Scrape type for RD71224: 0
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: CR11915
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR11915%27 HTTP/1.1" 200 None
2026-03-28 05:11:58 [auto1.nl] INFO: Scrape type for CR11915: 0
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV97350%27 HTTP/1.1" 200 None
2026-03-28 05:11:58 [auto1.nl] INFO: Scrape type for TV97350: 0
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA20726%27 HTTP/1.1" 200 None
2026-03-28 05:11:58 [auto1.nl] INFO: Scrape type for BA20726: 0
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT17806%27 HTTP/1.1" 200 None
2026-03-28 05:11:58 [auto1.nl] INFO: Scrape type for YT17806: 0
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-28 05:11:58 [auto1.nl] INFO: Scrape type for SY92282: 0
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-28 05:11:58 [auto1.nl] INFO: Scrape type for UY18740: 0
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-28 05:11:58 [auto1.nl] INFO: Scrape type for XW90615: 0
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-28 05:11:58 [auto1.nl] INFO: Found listing with ID: NL79871
2026-03-28 05:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:11:59 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 917 | hits on page: 40
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for PE89486: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: WM00486
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE73966%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for SE73966: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: YM72619
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB30302%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for BB30302: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM31499%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for EM31499: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU03556%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for CU03556: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: UB53809
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB53809%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for UB53809: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: EL08717
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: HL89699
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL89699%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for HL89699: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: NB67844
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: TY02674
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR73964%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for FR73964: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for BY94157: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: MZ83148
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: TF88410
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: YK64597
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AP41268%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for AP41268: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: VP87797
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP87797%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for VP87797: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: NS74153
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS74153%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for NS74153: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV84229%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for GV84229: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: NN84532
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN84532%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for NN84532: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE34591%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for YE34591: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: FZ65940
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ65940%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for FZ65940: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: TL21960
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: MV90025
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: GJ92310
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ92310%27 HTTP/1.1" 200 None
2026-03-28 05:11:59 [auto1.nl] INFO: Scrape type for GJ92310: 0
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: AE22840
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-28 05:11:59 [auto1.nl] INFO: Found listing with ID: WU52252
2026-03-28 05:11:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:12:01 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 917 | hits on page: 40
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: FB31523
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB31523%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for FB31523: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for KV87922: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: DV95890
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for DB11708: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: FG40185
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: GZ83628
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: NA39376
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA39376%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for NA39376: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for PY93062: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for DD48612: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for CM00428: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for TW55830: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59991%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for HH59991: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for FW39949: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for UR99157: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for AM07460: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for MZ50492: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: JY58487
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY58487%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for JY58487: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: NG63197
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for NP69601: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for HC58225: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: UD56346
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for VU12203: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for YR49127: 0
2026-03-28 05:12:01 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-28 05:12:01 [auto1.nl] INFO: Scrape type for FL63517: 0
2026-03-28 05:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:12:02 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 917 | hits on page: 40
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: HH96879
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for NR15886: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for PN82428: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for HD17412: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for EH64896: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for AC84495: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for KD36085: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for WP95967: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for UJ05110: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for GN89359: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for EL29526: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: NY79842
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: LR65933
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR65933%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for LR65933: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for WE00434: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for SZ87293: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for FK48987: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for NX76865: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for SM08260: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: TJ92302
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for GN05115: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for RY75066: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for AZ42388: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-28 05:12:02 [auto1.nl] INFO: Scrape type for ZP12059: 0
2026-03-28 05:12:02 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-28 05:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-28 05:12:03 [auto1.nl] INFO: Scrape type for EY58020: 0
2026-03-28 05:12:03 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-28 05:12:03 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 05:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-28 05:12:03 [auto1.nl] INFO: Scrape type for SA79399: 0
2026-03-28 05:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:12:04 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 917 | hits on page: 40
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: JK11532
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: HK93829
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: RF47261
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF47261%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for RF47261: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for FZ85660: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for VM41876: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for CP77095: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for YZ85937: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for AB34968: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP44065%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for HP44065: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for VB96147: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA14742%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for HA14742: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD39017%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for JD39017: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for GG02103: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for PY55457: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB17984%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for GB17984: 0
2026-03-28 05:12:04 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH77043%27 HTTP/1.1" 200 None
2026-03-28 05:12:04 [auto1.nl] INFO: Scrape type for LH77043: 0
2026-03-28 05:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:12:05 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 917 | hits on page: 40
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS59030%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for HS59030: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV01442%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for AV01442: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for FC64695: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for RC74760: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU15419%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for BU15419: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST70882%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for ST70882: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: AB92284
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ76935%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for ZZ76935: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ37745%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for DZ37745: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for BU16200: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for NX47084: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for SY53039: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW03238%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for AW03238: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for YN37403: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN83420%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for GN83420: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW44039%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for BW44039: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK86795%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for FK86795: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for NV18219: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL65263%27 HTTP/1.1" 200 None
2026-03-28 05:12:05 [auto1.nl] INFO: Scrape type for NL65263: 0
2026-03-28 05:12:05 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-28 05:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:12:06 [scrapy.extensions.logstats] INFO: Crawled 24 pages (at 11 pages/min), scraped 89 items (at 44 items/min)
2026-03-28 05:12:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 05:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:12:06 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 917 | hits on page: 40
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL62057%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for ZL62057: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA07201%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for PA07201: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU34213%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for WU34213: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for GP63449: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for FK39304: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for TC15988: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for WK29789: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for YH72796: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for FE21861: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for SV00912: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-28 05:12:06 [auto1.nl] INFO: Scrape type for BP06390: 0
2026-03-28 05:12:06 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-28 05:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for SV78620: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for JX11008: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for YT76844: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for RC74228: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for PA43644: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for NT33284: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX77318%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for AX77318: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-28 05:12:07 [auto1.nl] INFO: Scrape type for ZP69271: 0
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-28 05:12:07 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-28 05:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:12:08 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 917 | hits on page: 40
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for YB51800: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT81231%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for CT81231: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for JN77730: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for AE06801: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for VR09113: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for MW03156: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for WG27101: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for AX06352: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for YE50957: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for EU67961: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK52304%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for PK52304: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for SY05694: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for ZL63379: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW07946%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for SW07946: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for CK43593: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for FR68688: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG40529%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for XG40529: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-28 05:12:08 [auto1.nl] INFO: Scrape type for HK90585: 0
2026-03-28 05:12:08 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-28 05:12:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:12:10 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 917 | hits on page: 37
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for CR31925: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM13348%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for BM13348: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for FP18275: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for BV58634: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for MD45251: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM47540%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for RM47540: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for DZ87358: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for DN96174: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG27703%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for BG27703: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for EB00697: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for ES69537: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for WY03082: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for CJ41969: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for UF96545: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for GL61326: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for SY10793: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for EY85081: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for RP15329: 0
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-28 05:12:10 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-28 05:12:10 [auto1.nl] INFO: Scrape type for TB82163: 0
2026-03-28 05:12:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:12:11 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 917 | hits on page: 0
2026-03-28 05:12:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 05:12:11 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-28 05:12:11 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 178, <ScrapeType.BATCH_SKIPPED: 5>: 187}
2026-03-28 05:12:11 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (89 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-28T05_10_00.jl
2026-03-28 05:12:11 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 75867,
 'downloader/request_count': 28,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 26,
 'downloader/response_bytes': 4183656,
 'downloader/response_count': 28,
 'downloader/response_status_count/200': 28,
 'elapsed_time_seconds': 125.246529,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 5, 12, 11, 897450, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 89,
 'log_count/DEBUG': 1668,
 'log_count/INFO': 2225,
 'memusage/max': 163008512,
 'memusage/startup': 147861504,
 'request_depth_max': 27,
 'response_received_count': 28,
 'scheduler/dequeued': 28,
 'scheduler/dequeued/memory': 28,
 'scheduler/enqueued': 28,
 'scheduler/enqueued/memory': 28,
 'scrape_type/batch_skipped': 483,
 'scrape_type/price_update': 89,
 'scrape_type/skipped': 385,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 28,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.853846132173202,
 'scrapy-zyte-api/mean_response_seconds': 2.9683997706742957,
 'scrapy-zyte-api/processed': 28,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 28,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 27,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 28,
 'scrapy-zyte-api/request_args/httpRequestBody': 26,
 'scrapy-zyte-api/request_args/httpRequestMethod': 26,
 'scrapy-zyte-api/request_args/httpResponseBody': 28,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 28,
 'scrapy-zyte-api/request_args/sessionContext': 28,
 'scrapy-zyte-api/request_args/url': 28,
 'scrapy-zyte-api/status_codes/200': 28,
 'scrapy-zyte-api/success': 28,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 957,
 'source/total_available': 917,
 'start_time': datetime.datetime(2026, 3, 28, 5, 10, 6, 650921, tzinfo=datetime.timezone.utc)}
2026-03-28 05:12:11 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 05:12:12 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fde41fcb250>
2026-03-28 05:12:12 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fde41da06d0>