2026-03-28 07:10:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 07:10:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 07:10:06 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-28 07:10:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-28 07:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 07:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 07:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 07:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 07:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: fae505508957244c
2026-03-28 07:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 07:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-28T07_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 07:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 07:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 07:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 07:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 07:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 07:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 07:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 07:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-28 07:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 07:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 07:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 07:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 07:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 07:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 07:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 07:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 07:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 07:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 07:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 07:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-28 07:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 07:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 07:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 07:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 07:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 07:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 07:10:16 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:16 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-28 07:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-28 07:10:16 [auto1.nl] INFO: Scrape type for AV73218: 2
2026-03-28 07:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 857eb26d-7aa9-5141-aa32-329febaa3696 with identifier: AV73218
2026-03-28 07:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857eb26d-7aa9-5141-aa32-329febaa3696 with scrape type 2
2026-03-28 07:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 857eb26d-7aa9-5141-aa32-329febaa3696 with scrape type 2
2026-03-28 07:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 857eb26d-7aa9-5141-aa32-329febaa3696, identifier: AV73218
2026-03-28 07:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 857eb26d-7aa9-5141-aa32-329febaa3696 with identifier: AV73218
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 07:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 07:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 857eb26d-7aa9-5141-aa32-329febaa3696 with identifier: AV73218
2026-03-28 07:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 857eb26d-7aa9-5141-aa32-329febaa3696 with identifier: AV73218 to the API
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:10:57Z',
 'fuel_type': 'petrol',
 'id': '857eb26d-7aa9-5141-aa32-329febaa3696',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV73218',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 291523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-07',
 'seller_name': None,
 'title': 'Volvo V70 2.0 T Edition R-Design',
 'transmission': 'manual',
 'trim': 'Edition R-Design',
 'year': 2010}
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-28 07:10:17 [auto1.nl] INFO: Saving data for AV73218: {'auction_closing_time': 1774883457.0, 'created_time': 1773405067.077954, 'last_price_update_time': 1774681817.666588}
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AV73218') HTTP/1.1" 204 0
2026-03-28 07:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:17 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-28 07:10:17 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 07:10:17 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 07:10:17 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET91545%27 HTTP/1.1" 200 None
2026-03-28 07:10:17 [auto1.nl] INFO: Scrape type for ET91545: 2
2026-03-28 07:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f85da17-02cf-5b84-96d7-21ebbddb1992 with identifier: ET91545
2026-03-28 07:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f85da17-02cf-5b84-96d7-21ebbddb1992 with scrape type 2
2026-03-28 07:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f85da17-02cf-5b84-96d7-21ebbddb1992 with scrape type 2
2026-03-28 07:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f85da17-02cf-5b84-96d7-21ebbddb1992, identifier: ET91545
2026-03-28 07:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f85da17-02cf-5b84-96d7-21ebbddb1992 with identifier: ET91545
2026-03-28 07:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f85da17-02cf-5b84-96d7-21ebbddb1992 with identifier: ET91545
2026-03-28 07:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f85da17-02cf-5b84-96d7-21ebbddb1992 with identifier: ET91545 to the API
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 560,
 'expiration_date': '2026-03-28T16:41:01Z',
 'fuel_type': 'petrol',
 'id': '3f85da17-02cf-5b84-96d7-21ebbddb1992',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET91545',
 'listing': 'auction',
 'make': 'Bentley',
 'model': 'Continental Flying Spur',
 'odometer': 97910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-17',
 'seller_name': None,
 'title': 'Bentley Continental Flying Spur 6.0 W12 Biturbo Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2007}
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET91545%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Saving data for ET91545: {'auction_closing_time': 1774716061.0, 'created_time': 1773664274.29957, 'last_price_update_time': 1774681818.085411}
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ET91545') HTTP/1.1" 204 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC45761%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for VC45761: 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for RJ64387: 2
2026-03-28 07:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7124ea8f-0fa8-5541-86d8-7b401dfe3b16 with identifier: RJ64387
2026-03-28 07:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7124ea8f-0fa8-5541-86d8-7b401dfe3b16 with scrape type 2
2026-03-28 07:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7124ea8f-0fa8-5541-86d8-7b401dfe3b16 with scrape type 2
2026-03-28 07:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7124ea8f-0fa8-5541-86d8-7b401dfe3b16, identifier: RJ64387
2026-03-28 07:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7124ea8f-0fa8-5541-86d8-7b401dfe3b16 with identifier: RJ64387
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 07:10:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7124ea8f-0fa8-5541-86d8-7b401dfe3b16 with identifier: RJ64387
2026-03-28 07:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7124ea8f-0fa8-5541-86d8-7b401dfe3b16 with identifier: RJ64387 to the API
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:57Z',
 'fuel_type': 'diesel',
 'id': '7124ea8f-0fa8-5541-86d8-7b401dfe3b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ64387',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 242104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Saving data for RJ64387: {'auction_closing_time': 1774713897.0, 'created_time': 1773836940.819259, 'last_price_update_time': 1774681818.69369}
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RJ64387') HTTP/1.1" 204 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG19961%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for PG19961: 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for YW05960: 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for VX32369: 0
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 07:10:18 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-28 07:10:18 [auto1.nl] INFO: Scrape type for YP02517: 2
2026-03-28 07:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1848e65-6d98-5993-80a3-64aa1ea4b1f5 with identifier: YP02517
2026-03-28 07:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1848e65-6d98-5993-80a3-64aa1ea4b1f5 with scrape type 2
2026-03-28 07:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1848e65-6d98-5993-80a3-64aa1ea4b1f5 with scrape type 2
2026-03-28 07:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d1848e65-6d98-5993-80a3-64aa1ea4b1f5, identifier: YP02517
2026-03-28 07:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d1848e65-6d98-5993-80a3-64aa1ea4b1f5 with identifier: YP02517
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 07:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d1848e65-6d98-5993-80a3-64aa1ea4b1f5 with identifier: YP02517
2026-03-28 07:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d1848e65-6d98-5993-80a3-64aa1ea4b1f5 with identifier: YP02517 to the API
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:14:30Z',
 'fuel_type': 'petrol',
 'id': 'd1848e65-6d98-5993-80a3-64aa1ea4b1f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP02517',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 112192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-07',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-28 07:10:19 [auto1.nl] INFO: Saving data for YP02517: {'auction_closing_time': 1774714470.0, 'created_time': 1773837005.40594, 'last_price_update_time': 1774681819.440971}
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YP02517') HTTP/1.1" 204 0
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-28 07:10:19 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH14183%27 HTTP/1.1" 200 None
2026-03-28 07:10:19 [auto1.nl] INFO: Scrape type for EH14183: 0
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-28 07:10:19 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-28 07:10:19 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 07:10:19 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ01481%27 HTTP/1.1" 200 None
2026-03-28 07:10:19 [auto1.nl] INFO: Scrape type for PZ01481: 0
2026-03-28 07:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:20 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for AV73218: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET91545%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for ET91545: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC45761%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for VC45761: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for RJ64387: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG19961%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for PG19961: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for YW05960: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for VX32369: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for YP02517: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-28 07:10:20 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 07:10:20 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 07:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH14183%27 HTTP/1.1" 200 None
2026-03-28 07:10:21 [auto1.nl] INFO: Scrape type for EH14183: 0
2026-03-28 07:10:21 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 07:10:21 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 07:10:21 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 07:10:21 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 07:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-28 07:10:21 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-28 07:10:21 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 07:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-28 07:10:21 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-28 07:10:21 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 07:10:21 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 07:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ01481%27 HTTP/1.1" 200 None
2026-03-28 07:10:21 [auto1.nl] INFO: Scrape type for PZ01481: 0
2026-03-28 07:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:22 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF40574%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for RF40574: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for AA80905: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for WF02577: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for TU99712: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for RA23366: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for UB80121: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for LG71332: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for JM47469: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for BX66014: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for ME20407: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for SR40415: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for MZ48021: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for VH01672: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for FH34143: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for YP25238: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS95271%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for HS95271: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ78328%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for PJ78328: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW65068%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for MW65068: 0
2026-03-28 07:10:22 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB97698%27 HTTP/1.1" 200 None
2026-03-28 07:10:22 [auto1.nl] INFO: Scrape type for KB97698: 2
2026-03-28 07:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9a440a8-999c-5bf5-a844-1346b29b66f7 with identifier: KB97698
2026-03-28 07:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9a440a8-999c-5bf5-a844-1346b29b66f7 with scrape type 2
2026-03-28 07:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9a440a8-999c-5bf5-a844-1346b29b66f7 with scrape type 2
2026-03-28 07:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f9a440a8-999c-5bf5-a844-1346b29b66f7, identifier: KB97698
2026-03-28 07:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f9a440a8-999c-5bf5-a844-1346b29b66f7 with identifier: KB97698
2026-03-28 07:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f9a440a8-999c-5bf5-a844-1346b29b66f7 with identifier: KB97698
2026-03-28 07:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f9a440a8-999c-5bf5-a844-1346b29b66f7 with identifier: KB97698 to the API
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:13:36Z',
 'fuel_type': 'diesel',
 'id': 'f9a440a8-999c-5bf5-a844-1346b29b66f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB97698',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 268872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2013}
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB97698%27 HTTP/1.1" 200 None
2026-03-28 07:10:23 [auto1.nl] INFO: Saving data for KB97698: {'auction_closing_time': 1774714416.0, 'created_time': 1774465976.12792, 'last_price_update_time': 1774681823.016518}
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB97698') HTTP/1.1" 204 0
2026-03-28 07:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-28 07:10:23 [auto1.nl] INFO: Scrape type for UC91516: 0
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU39943%27 HTTP/1.1" 200 None
2026-03-28 07:10:23 [auto1.nl] INFO: Scrape type for LU39943: 0
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV76653%27 HTTP/1.1" 200 None
2026-03-28 07:10:23 [auto1.nl] INFO: Scrape type for CV76653: 2
2026-03-28 07:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c689b3-c9d4-501a-9f69-b57d53a89a38 with identifier: CV76653
2026-03-28 07:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c689b3-c9d4-501a-9f69-b57d53a89a38 with scrape type 2
2026-03-28 07:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c689b3-c9d4-501a-9f69-b57d53a89a38 with scrape type 2
2026-03-28 07:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 41c689b3-c9d4-501a-9f69-b57d53a89a38, identifier: CV76653
2026-03-28 07:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 41c689b3-c9d4-501a-9f69-b57d53a89a38 with identifier: CV76653
2026-03-28 07:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 41c689b3-c9d4-501a-9f69-b57d53a89a38 with identifier: CV76653
2026-03-28 07:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 41c689b3-c9d4-501a-9f69-b57d53a89a38 with identifier: CV76653 to the API
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:00:18Z',
 'fuel_type': 'petrol',
 'id': '41c689b3-c9d4-501a-9f69-b57d53a89a38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV76653',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 151578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-27',
 'seller_name': None,
 'title': 'BMW 7er 750i L xDrive',
 'transmission': 'automatic',
 'trim': 'L xDrive',
 'year': 2015}
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV76653%27 HTTP/1.1" 200 None
2026-03-28 07:10:23 [auto1.nl] INFO: Saving data for CV76653: {'auction_closing_time': 1774713618.0, 'created_time': 1774465990.058613, 'last_price_update_time': 1774681823.549441}
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CV76653') HTTP/1.1" 204 0
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ60443%27 HTTP/1.1" 200 None
2026-03-28 07:10:23 [auto1.nl] INFO: Scrape type for CZ60443: 2
2026-03-28 07:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab214040-3bfb-56a5-9d20-8c57cee6d41b with identifier: CZ60443
2026-03-28 07:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab214040-3bfb-56a5-9d20-8c57cee6d41b with scrape type 2
2026-03-28 07:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab214040-3bfb-56a5-9d20-8c57cee6d41b with scrape type 2
2026-03-28 07:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ab214040-3bfb-56a5-9d20-8c57cee6d41b, identifier: CZ60443
2026-03-28 07:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ab214040-3bfb-56a5-9d20-8c57cee6d41b with identifier: CZ60443
2026-03-28 07:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ab214040-3bfb-56a5-9d20-8c57cee6d41b with identifier: CZ60443
2026-03-28 07:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ab214040-3bfb-56a5-9d20-8c57cee6d41b with identifier: CZ60443 to the API
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:49:04Z',
 'fuel_type': 'diesel',
 'id': 'ab214040-3bfb-56a5-9d20-8c57cee6d41b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ60443',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 193452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-07',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 290 L2 Trend',
 'transmission': 'manual',
 'trim': '290 L2 Trend',
 'year': 2017}
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ60443%27 HTTP/1.1" 200 None
2026-03-28 07:10:23 [auto1.nl] INFO: Saving data for CZ60443: {'auction_closing_time': 1774716544.0, 'created_time': 1774465880.383923, 'last_price_update_time': 1774681823.97081}
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CZ60443') HTTP/1.1" 204 0
2026-03-28 07:10:23 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-28 07:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54016%27 HTTP/1.1" 200 None
2026-03-28 07:10:24 [auto1.nl] INFO: Scrape type for AB54016: 2
2026-03-28 07:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18299ce1-34ef-5c4e-9a85-349457319303 with identifier: AB54016
2026-03-28 07:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18299ce1-34ef-5c4e-9a85-349457319303 with scrape type 2
2026-03-28 07:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18299ce1-34ef-5c4e-9a85-349457319303 with scrape type 2
2026-03-28 07:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 18299ce1-34ef-5c4e-9a85-349457319303, identifier: AB54016
2026-03-28 07:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 18299ce1-34ef-5c4e-9a85-349457319303 with identifier: AB54016
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 07:10:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 18299ce1-34ef-5c4e-9a85-349457319303 with identifier: AB54016
2026-03-28 07:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 18299ce1-34ef-5c4e-9a85-349457319303 with identifier: AB54016 to the API
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:01:31Z',
 'fuel_type': 'petrol',
 'id': '18299ce1-34ef-5c4e-9a85-349457319303',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB54016',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 111973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54016%27 HTTP/1.1" 200 None
2026-03-28 07:10:24 [auto1.nl] INFO: Saving data for AB54016: {'auction_closing_time': 1774713691.0, 'created_time': 1774465982.576209, 'last_price_update_time': 1774681824.506092}
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB54016') HTTP/1.1" 204 0
2026-03-28 07:10:24 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-28 07:10:24 [auto1.nl] INFO: Scrape type for FJ00169: 0
2026-03-28 07:10:24 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WT58034%27 HTTP/1.1" 200 None
2026-03-28 07:10:24 [auto1.nl] INFO: Scrape type for WT58034: 0
2026-03-28 07:10:24 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-28 07:10:24 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM03723%27 HTTP/1.1" 200 None
2026-03-28 07:10:24 [auto1.nl] INFO: Scrape type for YM03723: 2
2026-03-28 07:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fe84f0a-3151-53eb-8257-136c94c9b260 with identifier: YM03723
2026-03-28 07:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fe84f0a-3151-53eb-8257-136c94c9b260 with scrape type 2
2026-03-28 07:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fe84f0a-3151-53eb-8257-136c94c9b260 with scrape type 2
2026-03-28 07:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3fe84f0a-3151-53eb-8257-136c94c9b260, identifier: YM03723
2026-03-28 07:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3fe84f0a-3151-53eb-8257-136c94c9b260 with identifier: YM03723
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 07:10:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3fe84f0a-3151-53eb-8257-136c94c9b260 with identifier: YM03723
2026-03-28 07:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3fe84f0a-3151-53eb-8257-136c94c9b260 with identifier: YM03723 to the API
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:22:34Z',
 'fuel_type': 'petrol',
 'id': '3fe84f0a-3151-53eb-8257-136c94c9b260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM03723',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 208454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM03723%27 HTTP/1.1" 200 None
2026-03-28 07:10:25 [auto1.nl] INFO: Saving data for YM03723: {'auction_closing_time': 1774714954.0, 'created_time': 1774465972.424168, 'last_price_update_time': 1774681825.088564}
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YM03723') HTTP/1.1" 204 0
2026-03-28 07:10:25 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR64287%27 HTTP/1.1" 200 None
2026-03-28 07:10:25 [auto1.nl] INFO: Scrape type for TR64287: 2
2026-03-28 07:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d7e16e-213f-5767-84bb-9951397c7fc1 with identifier: TR64287
2026-03-28 07:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d7e16e-213f-5767-84bb-9951397c7fc1 with scrape type 2
2026-03-28 07:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d7e16e-213f-5767-84bb-9951397c7fc1 with scrape type 2
2026-03-28 07:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 92d7e16e-213f-5767-84bb-9951397c7fc1, identifier: TR64287
2026-03-28 07:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 92d7e16e-213f-5767-84bb-9951397c7fc1 with identifier: TR64287
2026-03-28 07:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 92d7e16e-213f-5767-84bb-9951397c7fc1 with identifier: TR64287
2026-03-28 07:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 92d7e16e-213f-5767-84bb-9951397c7fc1 with identifier: TR64287 to the API
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:43:56Z',
 'fuel_type': 'petrol',
 'id': '92d7e16e-213f-5767-84bb-9951397c7fc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR64287',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 151160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-08',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TSI Cupra',
 'transmission': 'automatic',
 'trim': 'Cupra',
 'year': 2011}
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR64287%27 HTTP/1.1" 200 None
2026-03-28 07:10:25 [auto1.nl] INFO: Saving data for TR64287: {'auction_closing_time': 1774716236.0, 'created_time': 1774465988.970821, 'last_price_update_time': 1774681825.563692}
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TR64287') HTTP/1.1" 204 0
2026-03-28 07:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:26 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:26 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-28 07:10:26 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-28 07:10:26 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-28 07:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE34975%27 HTTP/1.1" 200 None
2026-03-28 07:10:26 [auto1.nl] INFO: Scrape type for LE34975: 2
2026-03-28 07:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 080635f3-dc8c-573f-b277-111654e6653e with identifier: LE34975
2026-03-28 07:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 080635f3-dc8c-573f-b277-111654e6653e with scrape type 2
2026-03-28 07:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 080635f3-dc8c-573f-b277-111654e6653e with scrape type 2
2026-03-28 07:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 080635f3-dc8c-573f-b277-111654e6653e, identifier: LE34975
2026-03-28 07:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 080635f3-dc8c-573f-b277-111654e6653e with identifier: LE34975
2026-03-28 07:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 080635f3-dc8c-573f-b277-111654e6653e with identifier: LE34975
2026-03-28 07:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 080635f3-dc8c-573f-b277-111654e6653e with identifier: LE34975 to the API
2026-03-28 07:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:30:15Z',
 'fuel_type': 'diesel',
 'id': '080635f3-dc8c-573f-b277-111654e6653e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE34975',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 178224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-15',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 1.9 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2008}
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE34975%27 HTTP/1.1" 200 None
2026-03-28 07:10:27 [auto1.nl] INFO: Saving data for LE34975: {'auction_closing_time': 1774715415.0, 'created_time': 1774465996.604473, 'last_price_update_time': 1774681827.069949}
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE34975') HTTP/1.1" 204 0
2026-03-28 07:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:27 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-28 07:10:27 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK53895%27 HTTP/1.1" 200 None
2026-03-28 07:10:27 [auto1.nl] INFO: Scrape type for FK53895: 0
2026-03-28 07:10:27 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-28 07:10:27 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-28 07:10:27 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX13279%27 HTTP/1.1" 200 None
2026-03-28 07:10:27 [auto1.nl] INFO: Scrape type for JX13279: 2
2026-03-28 07:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e04429b4-4700-5744-84f9-47ceec582753 with identifier: JX13279
2026-03-28 07:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e04429b4-4700-5744-84f9-47ceec582753 with scrape type 2
2026-03-28 07:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e04429b4-4700-5744-84f9-47ceec582753 with scrape type 2
2026-03-28 07:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e04429b4-4700-5744-84f9-47ceec582753, identifier: JX13279
2026-03-28 07:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e04429b4-4700-5744-84f9-47ceec582753 with identifier: JX13279
2026-03-28 07:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e04429b4-4700-5744-84f9-47ceec582753 with identifier: JX13279
2026-03-28 07:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e04429b4-4700-5744-84f9-47ceec582753 with identifier: JX13279 to the API
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:49Z',
 'fuel_type': 'diesel',
 'id': 'e04429b4-4700-5744-84f9-47ceec582753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX13279',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 214391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-07',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Momentum 2WD',
 'transmission': 'manual',
 'trim': 'Momentum 2WD',
 'year': 2013}
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX13279%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Saving data for JX13279: {'auction_closing_time': 1774713889.0, 'created_time': 1774465996.253244, 'last_price_update_time': 1774681828.074933}
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JX13279') HTTP/1.1" 204 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT56594%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for NT56594: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for XG57923: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for FU47491: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL54745%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for NL54745: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS22669%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for AS22669: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for BM26306: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: ZM76247
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for MM08239: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS94001%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for HS94001: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL56682%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for BL56682: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB63862%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for MB63862: 2
2026-03-28 07:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3fffff5-614b-5b37-98c5-40537264ac05 with identifier: MB63862
2026-03-28 07:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fffff5-614b-5b37-98c5-40537264ac05 with scrape type 2
2026-03-28 07:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3fffff5-614b-5b37-98c5-40537264ac05 with scrape type 2
2026-03-28 07:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d3fffff5-614b-5b37-98c5-40537264ac05, identifier: MB63862
2026-03-28 07:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d3fffff5-614b-5b37-98c5-40537264ac05 with identifier: MB63862
2026-03-28 07:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d3fffff5-614b-5b37-98c5-40537264ac05 with identifier: MB63862
2026-03-28 07:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d3fffff5-614b-5b37-98c5-40537264ac05 with identifier: MB63862 to the API
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:00Z',
 'fuel_type': 'petrol',
 'id': 'd3fffff5-614b-5b37-98c5-40537264ac05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB63862',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 145734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB63862%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Saving data for MB63862: {'auction_closing_time': 1774714680.0, 'created_time': 1774465985.438599, 'last_price_update_time': 1774681828.668388}
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB63862') HTTP/1.1" 204 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for SE84312: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE73396%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for PE73396: 0
2026-03-28 07:10:28 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY41827%27 HTTP/1.1" 200 None
2026-03-28 07:10:28 [auto1.nl] INFO: Scrape type for CY41827: 2
2026-03-28 07:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bbdec71-0f44-5d89-b104-7e61060e9224 with identifier: CY41827
2026-03-28 07:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bbdec71-0f44-5d89-b104-7e61060e9224 with scrape type 2
2026-03-28 07:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bbdec71-0f44-5d89-b104-7e61060e9224 with scrape type 2
2026-03-28 07:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8bbdec71-0f44-5d89-b104-7e61060e9224, identifier: CY41827
2026-03-28 07:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8bbdec71-0f44-5d89-b104-7e61060e9224 with identifier: CY41827
2026-03-28 07:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8bbdec71-0f44-5d89-b104-7e61060e9224 with identifier: CY41827
2026-03-28 07:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8bbdec71-0f44-5d89-b104-7e61060e9224 with identifier: CY41827 to the API
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:58:32Z',
 'fuel_type': 'petrol',
 'id': '8bbdec71-0f44-5d89-b104-7e61060e9224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY41827',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 84768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY41827%27 HTTP/1.1" 200 None
2026-03-28 07:10:29 [auto1.nl] INFO: Saving data for CY41827: {'auction_closing_time': 1774717112.0, 'created_time': 1774465982.920561, 'last_price_update_time': 1774681829.223058}
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY41827') HTTP/1.1" 204 0
2026-03-28 07:10:29 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-28 07:10:29 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-28 07:10:29 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG22704%27 HTTP/1.1" 200 None
2026-03-28 07:10:29 [auto1.nl] INFO: Scrape type for ZG22704: 0
2026-03-28 07:10:29 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS09006%27 HTTP/1.1" 200 None
2026-03-28 07:10:29 [auto1.nl] INFO: Scrape type for PS09006: 0
2026-03-28 07:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:30 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for KB59261: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF97973%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for PF97973: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG43162%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for YG43162: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY36712%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for MY36712: 2
2026-03-28 07:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9eff6df-8cf7-5dd1-95cd-f876758758df with identifier: MY36712
2026-03-28 07:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9eff6df-8cf7-5dd1-95cd-f876758758df with scrape type 2
2026-03-28 07:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9eff6df-8cf7-5dd1-95cd-f876758758df with scrape type 2
2026-03-28 07:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c9eff6df-8cf7-5dd1-95cd-f876758758df, identifier: MY36712
2026-03-28 07:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c9eff6df-8cf7-5dd1-95cd-f876758758df with identifier: MY36712
2026-03-28 07:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c9eff6df-8cf7-5dd1-95cd-f876758758df with identifier: MY36712
2026-03-28 07:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c9eff6df-8cf7-5dd1-95cd-f876758758df with identifier: MY36712 to the API
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:49:43Z',
 'fuel_type': 'petrol',
 'id': 'c9eff6df-8cf7-5dd1-95cd-f876758758df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY36712',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 278168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-17',
 'seller_name': None,
 'title': 'BMW 7er 750i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY36712%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Saving data for MY36712: {'auction_closing_time': 1774716583.0, 'created_time': 1774379626.956595, 'last_price_update_time': 1774681830.699565}
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MY36712') HTTP/1.1" 204 0
2026-03-28 07:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT43342%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for DT43342: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW63639%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for XW63639: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK25507%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for MK25507: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT18322%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for KT18322: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16632%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for LZ16632: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-28 07:10:30 [auto1.nl] INFO: Scrape type for ML63258: 0
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-28 07:10:30 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-28 07:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:33 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66252%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for GY66252: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD70514%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for UD70514: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for DS36560: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for SM80467: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for EW85240: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for GY89787: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX12849%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for EX12849: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for CH10226: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for VL07732: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH30413%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for TH30413: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LB35433%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for LB35433: 2
2026-03-28 07:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dab865b-f9d0-57a9-a79d-0142603a8d0a with identifier: LB35433
2026-03-28 07:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dab865b-f9d0-57a9-a79d-0142603a8d0a with scrape type 2
2026-03-28 07:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dab865b-f9d0-57a9-a79d-0142603a8d0a with scrape type 2
2026-03-28 07:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6dab865b-f9d0-57a9-a79d-0142603a8d0a, identifier: LB35433
2026-03-28 07:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6dab865b-f9d0-57a9-a79d-0142603a8d0a with identifier: LB35433
2026-03-28 07:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6dab865b-f9d0-57a9-a79d-0142603a8d0a with identifier: LB35433
2026-03-28 07:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6dab865b-f9d0-57a9-a79d-0142603a8d0a with identifier: LB35433 to the API
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-28T16:05:45Z',
 'fuel_type': 'petrol',
 'id': '6dab865b-f9d0-57a9-a79d-0142603a8d0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB35433',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z3',
 'odometer': 223592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-11-04',
 'seller_name': None,
 'title': 'BMW Z3 2.8',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LB35433%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Saving data for LB35433: {'auction_closing_time': 1774713945.0, 'created_time': 1774465980.323291, 'last_price_update_time': 1774681833.729173}
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LB35433') HTTP/1.1" 204 0
2026-03-28 07:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV30454%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for EV30454: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW15981%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for AW15981: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for DW43709: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM68781%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for AM68781: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU55364%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for MU55364: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV96248%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for PV96248: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-28 07:10:33 [auto1.nl] INFO: Scrape type for BC50110: 0
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-28 07:10:33 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-28 07:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:38 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV45583%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for VV45583: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02438%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for WF02438: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for RX16781: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ05855%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for BZ05855: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP94169%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for GP94169: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for JK88621: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for AJ38016: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN29511%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for LN29511: 2
2026-03-28 07:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b52eff4c-8d68-5ed6-a072-43befa384f69 with identifier: LN29511
2026-03-28 07:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b52eff4c-8d68-5ed6-a072-43befa384f69 with scrape type 2
2026-03-28 07:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b52eff4c-8d68-5ed6-a072-43befa384f69 with scrape type 2
2026-03-28 07:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b52eff4c-8d68-5ed6-a072-43befa384f69, identifier: LN29511
2026-03-28 07:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b52eff4c-8d68-5ed6-a072-43befa384f69 with identifier: LN29511
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 07:10:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b52eff4c-8d68-5ed6-a072-43befa384f69 with identifier: LN29511
2026-03-28 07:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b52eff4c-8d68-5ed6-a072-43befa384f69 with identifier: LN29511 to the API
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:13:29Z',
 'fuel_type': 'diesel',
 'id': 'b52eff4c-8d68-5ed6-a072-43befa384f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN29511',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 278692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN29511%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Saving data for LN29511: {'auction_closing_time': 1774714409.0, 'created_time': 1774465995.312334, 'last_price_update_time': 1774681838.749674}
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LN29511') HTTP/1.1" 204 0
2026-03-28 07:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55235%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for EF55235: 0
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-28 07:10:38 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF44438%27 HTTP/1.1" 200 None
2026-03-28 07:10:38 [auto1.nl] INFO: Scrape type for JF44438: 2
2026-03-28 07:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d3c7387-b999-5bfa-82ac-673bacfb6bb0 with identifier: JF44438
2026-03-28 07:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3c7387-b999-5bfa-82ac-673bacfb6bb0 with scrape type 2
2026-03-28 07:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d3c7387-b999-5bfa-82ac-673bacfb6bb0 with scrape type 2
2026-03-28 07:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8d3c7387-b999-5bfa-82ac-673bacfb6bb0, identifier: JF44438
2026-03-28 07:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8d3c7387-b999-5bfa-82ac-673bacfb6bb0 with identifier: JF44438
2026-03-28 07:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8d3c7387-b999-5bfa-82ac-673bacfb6bb0 with identifier: JF44438
2026-03-28 07:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8d3c7387-b999-5bfa-82ac-673bacfb6bb0 with identifier: JF44438 to the API
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:11Z',
 'fuel_type': 'petrol',
 'id': '8d3c7387-b999-5bfa-82ac-673bacfb6bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF44438',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 183773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-15',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2015}
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF44438%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Saving data for JF44438: {'auction_closing_time': 1774713851.0, 'created_time': 1774465970.265363, 'last_price_update_time': 1774681839.31701}
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JF44438') HTTP/1.1" 204 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM94423%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for MM94423: 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for JG46150: 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for VB13156: 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LM76108%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for LM76108: 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC25819%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for PC25819: 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC83701%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for UC83701: 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN34137%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for PN34137: 2
2026-03-28 07:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d87f6a50-7537-5d0c-81fd-062166a71919 with identifier: PN34137
2026-03-28 07:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d87f6a50-7537-5d0c-81fd-062166a71919 with scrape type 2
2026-03-28 07:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d87f6a50-7537-5d0c-81fd-062166a71919 with scrape type 2
2026-03-28 07:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d87f6a50-7537-5d0c-81fd-062166a71919, identifier: PN34137
2026-03-28 07:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d87f6a50-7537-5d0c-81fd-062166a71919 with identifier: PN34137
2026-03-28 07:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d87f6a50-7537-5d0c-81fd-062166a71919 with identifier: PN34137
2026-03-28 07:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d87f6a50-7537-5d0c-81fd-062166a71919 with identifier: PN34137 to the API
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:43:39Z',
 'fuel_type': 'petrol',
 'id': 'd87f6a50-7537-5d0c-81fd-062166a71919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN34137',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 77321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2021}
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN34137%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Saving data for PN34137: {'auction_closing_time': 1774716219.0, 'created_time': 1774465978.351518, 'last_price_update_time': 1774681839.875518}
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PN34137') HTTP/1.1" 204 0
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-28 07:10:39 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AU62322%27 HTTP/1.1" 200 None
2026-03-28 07:10:39 [auto1.nl] INFO: Scrape type for AU62322: 0
2026-03-28 07:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:40 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:40 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-28 07:10:40 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for VD56637: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS68012%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for YS68012: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS79214%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for AS79214: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22274%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for SV22274: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD33602%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for FD33602: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP56929%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for UP56929: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TK93788%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for TK93788: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for BZ75535: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for XD61678: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX58095%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for NX58095: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for XA55617: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH47891%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for BH47891: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST98483%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for ST98483: 2
2026-03-28 07:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 941aafc1-b3fb-58ae-a877-dfedd4052571 with identifier: ST98483
2026-03-28 07:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 941aafc1-b3fb-58ae-a877-dfedd4052571 with scrape type 2
2026-03-28 07:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 941aafc1-b3fb-58ae-a877-dfedd4052571 with scrape type 2
2026-03-28 07:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 941aafc1-b3fb-58ae-a877-dfedd4052571, identifier: ST98483
2026-03-28 07:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 941aafc1-b3fb-58ae-a877-dfedd4052571 with identifier: ST98483
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 07:10:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 941aafc1-b3fb-58ae-a877-dfedd4052571 with identifier: ST98483
2026-03-28 07:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 941aafc1-b3fb-58ae-a877-dfedd4052571 with identifier: ST98483 to the API
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:01:36Z',
 'fuel_type': 'petrol',
 'id': '941aafc1-b3fb-58ae-a877-dfedd4052571',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST98483',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 219305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-18',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST98483%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Saving data for ST98483: {'auction_closing_time': 1774713696.0, 'created_time': 1774465934.610658, 'last_price_update_time': 1774681841.729561}
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ST98483') HTTP/1.1" 204 0
2026-03-28 07:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV50646%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for ZV50646: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for FL22944: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for BM96536: 0
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-28 07:10:41 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP53707%27 HTTP/1.1" 200 None
2026-03-28 07:10:41 [auto1.nl] INFO: Scrape type for ZP53707: 2
2026-03-28 07:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 972e15aa-bb84-5963-b324-f7d80fdcc033 with identifier: ZP53707
2026-03-28 07:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 972e15aa-bb84-5963-b324-f7d80fdcc033 with scrape type 2
2026-03-28 07:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 972e15aa-bb84-5963-b324-f7d80fdcc033 with scrape type 2
2026-03-28 07:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 972e15aa-bb84-5963-b324-f7d80fdcc033, identifier: ZP53707
2026-03-28 07:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 972e15aa-bb84-5963-b324-f7d80fdcc033 with identifier: ZP53707
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 07:10:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 972e15aa-bb84-5963-b324-f7d80fdcc033 with identifier: ZP53707
2026-03-28 07:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 972e15aa-bb84-5963-b324-f7d80fdcc033 with identifier: ZP53707 to the API
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 462,
 'expiration_date': '2026-03-28T16:27:04Z',
 'fuel_type': 'hybrid',
 'id': '972e15aa-bb84-5963-b324-f7d80fdcc033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP53707',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 71614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-03',
 'seller_name': None,
 'title': 'Porsche Cayenne E-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP53707%27 HTTP/1.1" 200 None
2026-03-28 07:10:42 [auto1.nl] INFO: Saving data for ZP53707: {'auction_closing_time': 1774715224.0, 'created_time': 1773232370.474608, 'last_price_update_time': 1774681842.415891}
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP53707') HTTP/1.1" 204 0
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS66279%27 HTTP/1.1" 200 None
2026-03-28 07:10:42 [auto1.nl] INFO: Scrape type for DS66279: 0
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS83136%27 HTTP/1.1" 200 None
2026-03-28 07:10:42 [auto1.nl] INFO: Scrape type for RS83136: 0
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-28 07:10:42 [auto1.nl] INFO: Scrape type for BD37870: 0
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK22988%27 HTTP/1.1" 200 None
2026-03-28 07:10:42 [auto1.nl] INFO: Scrape type for PK22988: 0
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL29308%27 HTTP/1.1" 200 None
2026-03-28 07:10:42 [auto1.nl] INFO: Scrape type for HL29308: 0
2026-03-28 07:10:42 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-28 07:10:42 [auto1.nl] INFO: Scrape type for DG66253: 0
2026-03-28 07:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:44 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:44 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-28 07:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL71666%27 HTTP/1.1" 200 None
2026-03-28 07:10:44 [auto1.nl] INFO: Scrape type for WL71666: 0
2026-03-28 07:10:44 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-28 07:10:44 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-28 07:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG13282%27 HTTP/1.1" 200 None
2026-03-28 07:10:44 [auto1.nl] INFO: Scrape type for BG13282: 2
2026-03-28 07:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 921152a9-ad7f-5455-884e-402422a45763 with identifier: BG13282
2026-03-28 07:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 921152a9-ad7f-5455-884e-402422a45763 with scrape type 2
2026-03-28 07:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 921152a9-ad7f-5455-884e-402422a45763 with scrape type 2
2026-03-28 07:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 921152a9-ad7f-5455-884e-402422a45763, identifier: BG13282
2026-03-28 07:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 921152a9-ad7f-5455-884e-402422a45763 with identifier: BG13282
2026-03-28 07:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 921152a9-ad7f-5455-884e-402422a45763 with identifier: BG13282
2026-03-28 07:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 921152a9-ad7f-5455-884e-402422a45763 with identifier: BG13282 to the API
2026-03-28 07:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:23:05Z',
 'fuel_type': 'petrol',
 'id': '921152a9-ad7f-5455-884e-402422a45763',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG13282',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 115785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-14',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2015}
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG13282%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Saving data for BG13282: {'auction_closing_time': 1774714985.0, 'created_time': 1774465878.099866, 'last_price_update_time': 1774681845.665401}
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG13282') HTTP/1.1" 204 0
2026-03-28 07:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT24375%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for AT24375: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK53801%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for MK53801: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for SV01425: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN10776%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for NN10776: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD16289%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for PD16289: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK38952%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for AK38952: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR94083%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for JR94083: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN78419%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for GN78419: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-28 07:10:45 [auto1.nl] INFO: Scrape type for YK98733: 0
2026-03-28 07:10:45 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-28 07:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN62257%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for JN62257: 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for RX80263: 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH52378%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for GH52378: 2
2026-03-28 07:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea2cd50d-a700-5882-9762-459aaa090a0b with identifier: GH52378
2026-03-28 07:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea2cd50d-a700-5882-9762-459aaa090a0b with scrape type 2
2026-03-28 07:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea2cd50d-a700-5882-9762-459aaa090a0b with scrape type 2
2026-03-28 07:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea2cd50d-a700-5882-9762-459aaa090a0b, identifier: GH52378
2026-03-28 07:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea2cd50d-a700-5882-9762-459aaa090a0b with identifier: GH52378
2026-03-28 07:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea2cd50d-a700-5882-9762-459aaa090a0b with identifier: GH52378
2026-03-28 07:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea2cd50d-a700-5882-9762-459aaa090a0b with identifier: GH52378 to the API
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:46Z',
 'fuel_type': 'petrol',
 'id': 'ea2cd50d-a700-5882-9762-459aaa090a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH52378',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 99883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-26',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH52378%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Saving data for GH52378: {'auction_closing_time': 1774717186.0, 'created_time': 1774465973.088998, 'last_price_update_time': 1774681846.48016}
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GH52378') HTTP/1.1" 204 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ87592%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for YZ87592: 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG63476%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for TG63476: 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for WJ55319: 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA29712%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for NA29712: 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL27027%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for RL27027: 0
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-28 07:10:46 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-28 07:10:46 [auto1.nl] INFO: Scrape type for GY41852: 0
2026-03-28 07:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:47 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-28 07:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL15145%27 HTTP/1.1" 200 None
2026-03-28 07:10:47 [auto1.nl] INFO: Scrape type for HL15145: 0
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-28 07:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH65457%27 HTTP/1.1" 200 None
2026-03-28 07:10:47 [auto1.nl] INFO: Scrape type for JH65457: 0
2026-03-28 07:10:47 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-28 07:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG59138%27 HTTP/1.1" 200 None
2026-03-28 07:10:47 [auto1.nl] INFO: Scrape type for NG59138: 2
2026-03-28 07:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f799d850-cca7-5c11-a695-36acec69cda4 with identifier: NG59138
2026-03-28 07:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f799d850-cca7-5c11-a695-36acec69cda4 with scrape type 2
2026-03-28 07:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f799d850-cca7-5c11-a695-36acec69cda4 with scrape type 2
2026-03-28 07:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f799d850-cca7-5c11-a695-36acec69cda4, identifier: NG59138
2026-03-28 07:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f799d850-cca7-5c11-a695-36acec69cda4 with identifier: NG59138
2026-03-28 07:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f799d850-cca7-5c11-a695-36acec69cda4 with identifier: NG59138
2026-03-28 07:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f799d850-cca7-5c11-a695-36acec69cda4 with identifier: NG59138 to the API
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:24:56Z',
 'fuel_type': 'petrol',
 'id': 'f799d850-cca7-5c11-a695-36acec69cda4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG59138',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 105829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'BMW 2er 220i Active Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG59138%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Saving data for NG59138: {'auction_closing_time': 1774715096.0, 'created_time': 1774465942.735395, 'last_price_update_time': 1774681848.224642}
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NG59138') HTTP/1.1" 204 0
2026-03-28 07:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX87837%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for RX87837: 2
2026-03-28 07:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 091532d7-f22b-5dd5-879a-782dbd8ad1cc with identifier: RX87837
2026-03-28 07:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 091532d7-f22b-5dd5-879a-782dbd8ad1cc with scrape type 2
2026-03-28 07:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 091532d7-f22b-5dd5-879a-782dbd8ad1cc with scrape type 2
2026-03-28 07:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 091532d7-f22b-5dd5-879a-782dbd8ad1cc, identifier: RX87837
2026-03-28 07:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 091532d7-f22b-5dd5-879a-782dbd8ad1cc with identifier: RX87837
2026-03-28 07:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 091532d7-f22b-5dd5-879a-782dbd8ad1cc with identifier: RX87837
2026-03-28 07:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 091532d7-f22b-5dd5-879a-782dbd8ad1cc with identifier: RX87837 to the API
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:28:41Z',
 'fuel_type': 'petrol',
 'id': '091532d7-f22b-5dd5-879a-782dbd8ad1cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX87837',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 121542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-23',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 SBK',
 'transmission': 'manual',
 'trim': 'SBK',
 'year': 2013}
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX87837%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Saving data for RX87837: {'auction_closing_time': 1774715321.0, 'created_time': 1774465992.600246, 'last_price_update_time': 1774681848.727794}
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RX87837') HTTP/1.1" 204 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG73581%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for DG73581: 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for JS13271: 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: GM40908
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for NB25760: 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE69449%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for TE69449: 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR08683%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for YR08683: 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for BD28084: 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR97495%27 HTTP/1.1" 200 None
2026-03-28 07:10:48 [auto1.nl] INFO: Scrape type for LR97495: 0
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-28 07:10:48 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-28 07:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-28 07:10:49 [auto1.nl] INFO: Scrape type for VT81070: 0
2026-03-28 07:10:49 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-28 07:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS78971%27 HTTP/1.1" 200 None
2026-03-28 07:10:49 [auto1.nl] INFO: Scrape type for AS78971: 0
2026-03-28 07:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:50 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN86188%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for TN86188: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ31508%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for PZ31508: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN23343%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for DN23343: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for CP17463: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for EJ39658: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG27565%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for AG27565: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for SX35832: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for RF26708: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV40948%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for RV40948: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV80682%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for CV80682: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP01312%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for EP01312: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for CR08212: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD71761%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for BD71761: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for RD50492: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65627%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for UU65627: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for FA26024: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for ZY88945: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for BX68417: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY95005%27 HTTP/1.1" 200 None
2026-03-28 07:10:50 [auto1.nl] INFO: Scrape type for NY95005: 0
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-28 07:10:50 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-28 07:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:51 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY33770%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for BY33770: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE36776%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for YE36776: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for CT01963: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS92650%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for TS92650: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW78376%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for YW78376: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW41282%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for SW41282: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ22600%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for PZ22600: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN28689%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for BN28689: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for MD57319: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK48888%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for CK48888: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for GD99184: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV32142%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for WV32142: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for WC97739: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC21923%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for MC21923: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for ZL38920: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK82229%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for AK82229: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD16016%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for FD16016: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX54730%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for NX54730: 0
2026-03-28 07:10:51 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ22754%27 HTTP/1.1" 200 None
2026-03-28 07:10:51 [auto1.nl] INFO: Scrape type for HZ22754: 0
2026-03-28 07:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:53 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC55354%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for FC55354: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92567%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for UU92567: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD69435%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for SD69435: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD75991%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for LD75991: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for CL54405: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ31369%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for CJ31369: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: WV84251
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for MD55137: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for ZE21436: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for TU57635: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ77908%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for LJ77908: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS89780%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for GS89780: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA86988%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for VA86988: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD32446%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for XD32446: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XB72700%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for XB72700: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX44669%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for AX44669: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV41758%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for XV41758: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for VL80205: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN49901%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for PN49901: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA98443%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for WA98443: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for RJ32742: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for LC20908: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: GJ08711
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ08711%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for GJ08711: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-28 07:10:53 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-28 07:10:53 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-28 07:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:54 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD05711%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for TD05711: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV28211%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for TV28211: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB61734%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for NB61734: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP69884%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for RP69884: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for VL52985: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: EL39193
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA16838%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for BA16838: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for SS31744: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for TP84646: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM20026%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for RM20026: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX87704%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for MX87704: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH98197%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for EH98197: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for JZ35389: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG56616%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for HG56616: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR89214%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for MR89214: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for SG32295: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-28 07:10:54 [auto1.nl] INFO: Scrape type for TJ11018: 0
2026-03-28 07:10:54 [auto1.nl] INFO: Found listing with ID: HL48318
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL48318%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for HL48318: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: VN36525
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC82380%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for RC82380: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for AX28541: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK31365%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for KK31365: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22652%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for SV22652: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: NM97362
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM97362%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for NM97362: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for LE78061: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-28 07:10:55 [auto1.nl] INFO: Scrape type for MD18353: 0
2026-03-28 07:10:55 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-28 07:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:56 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for JL68792: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UK83589%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for UK83589: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM82020%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for JM82020: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17699%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for RT17699: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for NT73578: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: ZP63957
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63957%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for ZP63957: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for ZX00670: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: NS77626
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS77626%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for NS77626: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA68002%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for DA68002: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: FH97185
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX15335%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for LX15335: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF13201%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for KF13201: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for FJ04475: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: NM87332
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM87332%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for NM87332: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN54197%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for MN54197: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW77077%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for VW77077: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN17461%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for JN17461: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: HC37182
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: CT04767
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for NS14796: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for BP47777: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER73656%27 HTTP/1.1" 200 None
2026-03-28 07:10:56 [auto1.nl] INFO: Scrape type for ER73656: 0
2026-03-28 07:10:56 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-28 07:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:57 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: LZ58703
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: WB40041
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for FJ96412: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: VH11794
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16720%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for HT16720: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: XC91044
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC91044%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for XC91044: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: CM13419
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM13419%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for CM13419: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: EX83153
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: DL78347
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL78347%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for DL78347: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: DX59899
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ17993%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for EJ17993: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: WS72354
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for FD56899: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for AW61305: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL82021%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for NL82021: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: RD71224
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD71224%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for RD71224: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: CR11915
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR11915%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for CR11915: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV97350%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for TV97350: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA20726%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for BA20726: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT17806%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for YT17806: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for SY92282: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-28 07:10:57 [auto1.nl] INFO: Scrape type for UY18740: 0
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 07:10:57 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-28 07:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-28 07:10:58 [auto1.nl] INFO: Scrape type for XW90615: 0
2026-03-28 07:10:58 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-28 07:10:58 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-28 07:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:10:59 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 918 | hits on page: 40
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: NL79871
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for PE89486: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: WM00486
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE73966%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for SE73966: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: YM72619
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB30302%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for BB30302: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM31499%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for EM31499: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU03556%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for CU03556: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: UB53809
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB53809%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for UB53809: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: EL08717
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: HL89699
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL89699%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for HL89699: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: NB67844
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: TY02674
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR73964%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for FR73964: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for BY94157: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: MZ83148
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: TF88410
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: YK64597
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AP41268%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for AP41268: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: VP87797
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP87797%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for VP87797: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: NS74153
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS74153%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for NS74153: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV84229%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for GV84229: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: NN84532
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN84532%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for NN84532: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE34591%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for YE34591: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: FZ65940
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ65940%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for FZ65940: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: TL21960
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: MV90025
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: GJ92310
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ92310%27 HTTP/1.1" 200 None
2026-03-28 07:10:59 [auto1.nl] INFO: Scrape type for GJ92310: 0
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: AE22840
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-28 07:10:59 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-28 07:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:11:00 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 918 | hits on page: 40
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: WU52252
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: FB31523
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB31523%27 HTTP/1.1" 200 None
2026-03-28 07:11:00 [auto1.nl] INFO: Scrape type for FB31523: 0
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-28 07:11:00 [auto1.nl] INFO: Scrape type for KV87922: 0
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-28 07:11:00 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: DV95890
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-28 07:11:00 [auto1.nl] INFO: Scrape type for DB11708: 0
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: FG40185
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: GZ83628
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: NA39376
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA39376%27 HTTP/1.1" 200 None
2026-03-28 07:11:00 [auto1.nl] INFO: Scrape type for NA39376: 0
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-28 07:11:00 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-28 07:11:00 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-28 07:11:00 [auto1.nl] INFO: Scrape type for PY93062: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for DD48612: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for CM00428: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for TW55830: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59991%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for HH59991: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for FW39949: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for UR99157: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for AM07460: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for MZ50492: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: JY58487
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY58487%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for JY58487: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: NG63197
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for NP69601: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for HC58225: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: UD56346
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for VU12203: 0
2026-03-28 07:11:01 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-28 07:11:01 [auto1.nl] INFO: Scrape type for YR49127: 0
2026-03-28 07:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:11:02 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 918 | hits on page: 40
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for FL63517: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: HH96879
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for NR15886: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for PN82428: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for HD17412: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for EH64896: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for AC84495: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for KD36085: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for WP95967: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for UJ05110: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for GN89359: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for EL29526: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: NY79842
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: LR65933
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR65933%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for LR65933: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for WE00434: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for SZ87293: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for FK48987: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for NX76865: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for SM08260: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: TJ92302
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for GN05115: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for RY75066: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for AZ42388: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for ZP12059: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-28 07:11:02 [auto1.nl] INFO: Scrape type for EY58020: 0
2026-03-28 07:11:02 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-28 07:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:11:04 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 918 | hits on page: 40
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for SA79399: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: JK11532
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: HK93829
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: RF47261
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF47261%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for RF47261: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for FZ85660: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for VM41876: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for CP77095: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for YZ85937: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for AB34968: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP44065%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for HP44065: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for VB96147: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA14742%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for HA14742: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD39017%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for JD39017: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-28 07:11:04 [auto1.nl] INFO: Scrape type for GG02103: 0
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-28 07:11:04 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-28 07:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-28 07:11:05 [auto1.nl] INFO: Scrape type for PY55457: 0
2026-03-28 07:11:05 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-28 07:11:05 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-28 07:11:05 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-28 07:11:05 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-28 07:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB17984%27 HTTP/1.1" 200 None
2026-03-28 07:11:05 [auto1.nl] INFO: Scrape type for GB17984: 0
2026-03-28 07:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:11:06 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 918 | hits on page: 40
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH77043%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for LH77043: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS59030%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for HS59030: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV01442%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for AV01442: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for FC64695: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for RC74760: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU15419%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for BU15419: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST70882%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for ST70882: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: AB92284
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ76935%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for ZZ76935: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ37745%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for DZ37745: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for BU16200: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for NX47084: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for SY53039: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW03238%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for AW03238: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for YN37403: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN83420%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for GN83420: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW44039%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for BW44039: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK86795%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for FK86795: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for NV18219: 0
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-28 07:11:06 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL65263%27 HTTP/1.1" 200 None
2026-03-28 07:11:06 [auto1.nl] INFO: Scrape type for NL65263: 0
2026-03-28 07:11:06 [scrapy.extensions.logstats] INFO: Crawled 24 pages (at 24 pages/min), scraped 25 items (at 25 items/min)
2026-03-28 07:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-28 07:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:11:21 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 918 | hits on page: 40
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL62057%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for ZL62057: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA07201%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for PA07201: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU34213%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for WU34213: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for GP63449: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for FK39304: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for TC15988: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for WK29789: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for YH72796: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for FE21861: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for SV00912: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for BP06390: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for SV78620: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for JX11008: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for YT76844: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for RC74228: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for PA43644: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for NT33284: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX77318%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for AX77318: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-28 07:11:21 [auto1.nl] INFO: Scrape type for ZP69271: 0
2026-03-28 07:11:21 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-28 07:11:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:11:22 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 918 | hits on page: 40
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for YB51800: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT81231%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for CT81231: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for JN77730: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for AE06801: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for VR09113: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for MW03156: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for WG27101: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for AX06352: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for YE50957: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for EU67961: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK52304%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for PK52304: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for SY05694: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for ZL63379: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW07946%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for SW07946: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for CK43593: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for FR68688: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG40529%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for XG40529: 0
2026-03-28 07:11:22 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-28 07:11:22 [auto1.nl] INFO: Scrape type for HK90585: 0
2026-03-28 07:11:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:11:23 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 918 | hits on page: 38
2026-03-28 07:11:23 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-28 07:11:23 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-28 07:11:23 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-28 07:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-28 07:11:23 [auto1.nl] INFO: Scrape type for CR31925: 0
2026-03-28 07:11:23 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-28 07:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM13348%27 HTTP/1.1" 200 None
2026-03-28 07:11:23 [auto1.nl] INFO: Scrape type for BM13348: 0
2026-03-28 07:11:23 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-28 07:11:23 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-28 07:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-28 07:11:23 [auto1.nl] INFO: Scrape type for FP18275: 0
2026-03-28 07:11:23 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-28 07:11:23 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-28 07:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for BV58634: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for MD45251: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM47540%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for RM47540: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for DZ87358: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for DN96174: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG27703%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for BG27703: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for EB00697: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for ES69537: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for WY03082: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for CJ41969: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for UF96545: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for GL61326: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for SY10793: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for EY85081: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for RP15329: 0
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-28 07:11:24 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-28 07:11:24 [auto1.nl] INFO: Scrape type for TB82163: 2
2026-03-28 07:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-28 07:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 086af578-e4ba-54fb-83d4-b849f1da9f91 with scrape type 2
2026-03-28 07:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 086af578-e4ba-54fb-83d4-b849f1da9f91 with scrape type 2
2026-03-28 07:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 086af578-e4ba-54fb-83d4-b849f1da9f91, identifier: TB82163
2026-03-28 07:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-28 07:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-28 07:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163 to the API
2026-03-28 07:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:55:13Z',
 'fuel_type': 'diesel',
 'id': '086af578-e4ba-54fb-83d4-b849f1da9f91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB82163',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 277690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 07:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-28 07:11:26 [auto1.nl] INFO: Saving data for TB82163: {'auction_closing_time': 1774716913.0, 'created_time': 1774595432.056518, 'last_price_update_time': 1774681886.072785}
2026-03-28 07:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TB82163') HTTP/1.1" 204 0
2026-03-28 07:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:11:26 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 918 | hits on page: 0
2026-03-28 07:11:26 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 07:11:26 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-28 07:11:26 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-28 07:11:27 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (26 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-28T07_10_00.jl
2026-03-28 07:11:27 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 75871,
 'downloader/request_count': 28,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 26,
 'downloader/response_bytes': 4188238,
 'downloader/response_count': 28,
 'downloader/response_status_count/200': 28,
 'elapsed_time_seconds': 80.423013,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 7, 11, 27, 89585, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 26,
 'log_count/DEBUG': 1223,
 'log_count/INFO': 1719,
 'memusage/max': 163725312,
 'memusage/startup': 147525632,
 'request_depth_max': 27,
 'response_received_count': 28,
 'scheduler/dequeued': 28,
 'scheduler/dequeued/memory': 28,
 'scheduler/enqueued': 28,
 'scheduler/enqueued/memory': 28,
 'scrape_type/batch_skipped': 483,
 'scrape_type/price_update': 26,
 'scrape_type/skipped': 449,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 28,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 1.9085641120327634,
 'scrapy-zyte-api/mean_response_seconds': 2.0438148161130294,
 'scrapy-zyte-api/processed': 28,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 28,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 27,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 28,
 'scrapy-zyte-api/request_args/httpRequestBody': 26,
 'scrapy-zyte-api/request_args/httpRequestMethod': 26,
 'scrapy-zyte-api/request_args/httpResponseBody': 28,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 28,
 'scrapy-zyte-api/request_args/sessionContext': 28,
 'scrapy-zyte-api/request_args/url': 28,
 'scrapy-zyte-api/status_codes/200': 28,
 'scrapy-zyte-api/success': 28,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 958,
 'source/total_available': 918,
 'start_time': datetime.datetime(2026, 3, 28, 7, 10, 6, 666572, tzinfo=datetime.timezone.utc)}
2026-03-28 07:11:27 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 07:11:27 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8e9cf7a510>
2026-03-28 07:11:27 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8e9c086050>