2026-03-30 07:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 07:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 07:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-30 07:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-30 07:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 07:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 07:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 07:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 07:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: 72e0c42c18eb2cd4
2026-03-30 07:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 07:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-30T07_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 07:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 07:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 07:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 07:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 07:00:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 07:00:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 07:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 07:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 07:00:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 07:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 07:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 07:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 07:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 07:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 07:00:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 07:00:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 07:00:07 [scrapy.core.engine] INFO: Spider opened
2026-03-30 07:00:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 07:00:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 07:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 07:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 07:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 07:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 07:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 07:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 07:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 07:00:23 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 783 | hits on page: 40
2026-03-30 07:00:23 [auto1.nl] INFO: Found listing with ID: UR49266
2026-03-30 07:00:23 [auto1.nl] INFO: Found listing with ID: ZG07781
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG07781%27 HTTP/1.1" 200 None
2026-03-30 07:00:23 [auto1.nl] INFO: Scrape type for ZG07781: 2
2026-03-30 07:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7c6ee0-ea8c-534c-8373-29a784b445ba with identifier: ZG07781
2026-03-30 07:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7c6ee0-ea8c-534c-8373-29a784b445ba with scrape type 2
2026-03-30 07:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e7c6ee0-ea8c-534c-8373-29a784b445ba with scrape type 2
2026-03-30 07:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e7c6ee0-ea8c-534c-8373-29a784b445ba, identifier: ZG07781
2026-03-30 07:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e7c6ee0-ea8c-534c-8373-29a784b445ba with identifier: ZG07781
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 07:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 07:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e7c6ee0-ea8c-534c-8373-29a784b445ba with identifier: ZG07781
2026-03-30 07:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e7c6ee0-ea8c-534c-8373-29a784b445ba with identifier: ZG07781 to the API
2026-03-30 07:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:47:40Z',
'fuel_type': 'petrol',
'id': '2e7c6ee0-ea8c-534c-8373-29a784b445ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG07781',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 254933,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-31',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI S line Sportpaket',
'transmission': 'automatic',
'trim': 'S line Sportpaket',
'year': 2013}
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG07781%27 HTTP/1.1" 200 None
2026-03-30 07:00:32 [auto1.nl] INFO: Saving data for ZG07781: {'auction_closing_time': 1774972060.0, 'created_time': 1773688410.53793, 'last_price_update_time': 1774854032.352747}
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG07781') HTTP/1.1" 204 0
2026-03-30 07:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:00:32 [auto1.nl] INFO: Found listing with ID: NC71096
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC71096%27 HTTP/1.1" 200 None
2026-03-30 07:00:32 [auto1.nl] INFO: Scrape type for NC71096: 2
2026-03-30 07:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb9f191c-5091-51f4-8c35-c36046383706 with identifier: NC71096
2026-03-30 07:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb9f191c-5091-51f4-8c35-c36046383706 with scrape type 2
2026-03-30 07:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb9f191c-5091-51f4-8c35-c36046383706 with scrape type 2
2026-03-30 07:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fb9f191c-5091-51f4-8c35-c36046383706, identifier: NC71096
2026-03-30 07:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fb9f191c-5091-51f4-8c35-c36046383706 with identifier: NC71096
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 07:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fb9f191c-5091-51f4-8c35-c36046383706 with identifier: NC71096
2026-03-30 07:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fb9f191c-5091-51f4-8c35-c36046383706 with identifier: NC71096 to the API
2026-03-30 07:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:41:38Z',
'fuel_type': 'petrol',
'id': 'fb9f191c-5091-51f4-8c35-c36046383706',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC71096',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 265378,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-30',
'seller_name': None,
'title': 'Honda Civic 1.8 VTEC Type S',
'transmission': 'automatic',
'trim': 'Type S',
'year': 2008}
2026-03-30 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC71096%27 HTTP/1.1" 200 None
2026-03-30 07:00:40 [auto1.nl] INFO: Saving data for NC71096: {'auction_closing_time': 1774971698.0, 'created_time': 1773132782.871891, 'last_price_update_time': 1774854040.253087}
2026-03-30 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NC71096') HTTP/1.1" 204 0
2026-03-30 07:00:40 [auto1.nl] INFO: Found listing with ID: FV06268
2026-03-30 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV06268%27 HTTP/1.1" 200 None
2026-03-30 07:00:40 [auto1.nl] INFO: Scrape type for FV06268: 2
2026-03-30 07:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fb3c9b1-a490-5448-876b-7f7518cdaea4 with identifier: FV06268
2026-03-30 07:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fb3c9b1-a490-5448-876b-7f7518cdaea4 with scrape type 2
2026-03-30 07:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fb3c9b1-a490-5448-876b-7f7518cdaea4 with scrape type 2
2026-03-30 07:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1fb3c9b1-a490-5448-876b-7f7518cdaea4, identifier: FV06268
2026-03-30 07:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1fb3c9b1-a490-5448-876b-7f7518cdaea4 with identifier: FV06268
2026-03-30 07:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1fb3c9b1-a490-5448-876b-7f7518cdaea4 with identifier: FV06268
2026-03-30 07:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1fb3c9b1-a490-5448-876b-7f7518cdaea4 with identifier: FV06268 to the API
2026-03-30 07:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:11:06Z',
'fuel_type': 'petrol',
'id': '1fb3c9b1-a490-5448-876b-7f7518cdaea4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV06268',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 206728,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-04',
'seller_name': None,
'title': 'Peugeot 107 1.0 Filou',
'transmission': 'manual',
'trim': 'Filou',
'year': 2011}
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV06268%27 HTTP/1.1" 200 None
2026-03-30 07:00:50 [auto1.nl] INFO: Saving data for FV06268: {'auction_closing_time': 1774969866.0, 'created_time': 1773132359.706202, 'last_price_update_time': 1774854050.207958}
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FV06268') HTTP/1.1" 204 0
2026-03-30 07:00:50 [auto1.nl] INFO: Found listing with ID: UD25640
2026-03-30 07:00:50 [auto1.nl] INFO: Found listing with ID: YL18933
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YL18933%27 HTTP/1.1" 200 None
2026-03-30 07:00:50 [auto1.nl] INFO: Scrape type for YL18933: 2
2026-03-30 07:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755705aa-fb0b-529e-90b6-9b618f5d8ae2 with identifier: YL18933
2026-03-30 07:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 755705aa-fb0b-529e-90b6-9b618f5d8ae2 with scrape type 2
2026-03-30 07:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 755705aa-fb0b-529e-90b6-9b618f5d8ae2 with scrape type 2
2026-03-30 07:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 755705aa-fb0b-529e-90b6-9b618f5d8ae2, identifier: YL18933
2026-03-30 07:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 755705aa-fb0b-529e-90b6-9b618f5d8ae2 with identifier: YL18933
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 07:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 755705aa-fb0b-529e-90b6-9b618f5d8ae2 with identifier: YL18933
2026-03-30 07:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 755705aa-fb0b-529e-90b6-9b618f5d8ae2 with identifier: YL18933 to the API
2026-03-30 07:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:32:17Z',
'fuel_type': 'petrol',
'id': '755705aa-fb0b-529e-90b6-9b618f5d8ae2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL18933',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo',
'odometer': 123226,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-21',
'seller_name': None,
'title': 'Opel Combo 1.4 Kasten L2H1 2,4t',
'transmission': 'manual',
'trim': 'Kasten L2H1 2,4t',
'year': 2017}
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YL18933%27 HTTP/1.1" 200 None
2026-03-30 07:01:05 [auto1.nl] INFO: Saving data for YL18933: {'auction_closing_time': 1774971137.0, 'created_time': 1773688310.491805, 'last_price_update_time': 1774854065.102282}
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YL18933') HTTP/1.1" 204 0
2026-03-30 07:01:05 [auto1.nl] INFO: Found listing with ID: TN50119
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN50119%27 HTTP/1.1" 200 None
2026-03-30 07:01:05 [auto1.nl] INFO: Scrape type for TN50119: 1
2026-03-30 07:01:05 [auto1.nl] INFO: Found listing with ID: YV69069
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV69069%27 HTTP/1.1" 200 None
2026-03-30 07:01:05 [auto1.nl] INFO: Scrape type for YV69069: 2
2026-03-30 07:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48ad2802-a592-55e9-9263-bee8b49fad27 with identifier: YV69069
2026-03-30 07:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48ad2802-a592-55e9-9263-bee8b49fad27 with scrape type 2
2026-03-30 07:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48ad2802-a592-55e9-9263-bee8b49fad27 with scrape type 2
2026-03-30 07:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 48ad2802-a592-55e9-9263-bee8b49fad27, identifier: YV69069
2026-03-30 07:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 48ad2802-a592-55e9-9263-bee8b49fad27 with identifier: YV69069
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 07:01:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 48ad2802-a592-55e9-9263-bee8b49fad27 with identifier: YV69069
2026-03-30 07:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 48ad2802-a592-55e9-9263-bee8b49fad27 with identifier: YV69069 to the API
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:37:49Z',
'fuel_type': 'petrol',
'id': '48ad2802-a592-55e9-9263-bee8b49fad27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV69069',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 203513,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-29',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
'transmission': 'automatic',
'trim': 'Turismo',
'year': 2013}
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV69069%27 HTTP/1.1" 200 None
2026-03-30 07:01:05 [auto1.nl] INFO: Saving data for YV69069: {'auction_closing_time': 1774971469.0, 'created_time': 1773688445.791337, 'last_price_update_time': 1774854065.949599}
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YV69069') HTTP/1.1" 204 0
2026-03-30 07:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:05 [auto1.nl] INFO: Found listing with ID: MU90689
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU90689%27 HTTP/1.1" 200 None
2026-03-30 07:01:05 [auto1.nl] INFO: Scrape type for MU90689: 2
2026-03-30 07:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46865afe-54c5-5cd5-a81a-bfaaaf60231e with identifier: MU90689
2026-03-30 07:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46865afe-54c5-5cd5-a81a-bfaaaf60231e with scrape type 2
2026-03-30 07:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46865afe-54c5-5cd5-a81a-bfaaaf60231e with scrape type 2
2026-03-30 07:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46865afe-54c5-5cd5-a81a-bfaaaf60231e, identifier: MU90689
2026-03-30 07:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46865afe-54c5-5cd5-a81a-bfaaaf60231e with identifier: MU90689
2026-03-30 07:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46865afe-54c5-5cd5-a81a-bfaaaf60231e with identifier: MU90689
2026-03-30 07:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46865afe-54c5-5cd5-a81a-bfaaaf60231e with identifier: MU90689 to the API
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:39:57Z',
'fuel_type': 'petrol',
'id': '46865afe-54c5-5cd5-a81a-bfaaaf60231e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU90689',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 104104,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-24',
'seller_name': None,
'title': 'Audi A4 1.4 TFSI ACT',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU90689%27 HTTP/1.1" 200 None
2026-03-30 07:01:06 [auto1.nl] INFO: Saving data for MU90689: {'auction_closing_time': 1774971597.0, 'created_time': 1773688381.325121, 'last_price_update_time': 1774854066.475811}
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MU90689') HTTP/1.1" 204 0
2026-03-30 07:01:06 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-30 07:01:06 [auto1.nl] INFO: Found listing with ID: MR60949
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR60949%27 HTTP/1.1" 200 None
2026-03-30 07:01:06 [auto1.nl] INFO: Scrape type for MR60949: 2
2026-03-30 07:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0589ff1-1370-57bd-afad-a0b90394df54 with identifier: MR60949
2026-03-30 07:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0589ff1-1370-57bd-afad-a0b90394df54 with scrape type 2
2026-03-30 07:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0589ff1-1370-57bd-afad-a0b90394df54 with scrape type 2
2026-03-30 07:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b0589ff1-1370-57bd-afad-a0b90394df54, identifier: MR60949
2026-03-30 07:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b0589ff1-1370-57bd-afad-a0b90394df54 with identifier: MR60949
2026-03-30 07:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b0589ff1-1370-57bd-afad-a0b90394df54 with identifier: MR60949
2026-03-30 07:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b0589ff1-1370-57bd-afad-a0b90394df54 with identifier: MR60949 to the API
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:34:19Z',
'fuel_type': 'petrol',
'id': 'b0589ff1-1370-57bd-afad-a0b90394df54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR60949',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 161139,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-16',
'seller_name': None,
'title': 'Peugeot 308 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2008}
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR60949%27 HTTP/1.1" 200 None
2026-03-30 07:01:06 [auto1.nl] INFO: Saving data for MR60949: {'auction_closing_time': 1774971259.0, 'created_time': 1774292455.461096, 'last_price_update_time': 1774854066.982177}
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MR60949') HTTP/1.1" 204 0
2026-03-30 07:01:07 [auto1.nl] INFO: Found listing with ID: VF08835
2026-03-30 07:01:07 [auto1.nl] INFO: Found listing with ID: FM69133
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM69133%27 HTTP/1.1" 200 None
2026-03-30 07:01:07 [auto1.nl] INFO: Scrape type for FM69133: 2
2026-03-30 07:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4835dcf-f181-50ca-92e7-3ef638f183c1 with identifier: FM69133
2026-03-30 07:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4835dcf-f181-50ca-92e7-3ef638f183c1 with scrape type 2
2026-03-30 07:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4835dcf-f181-50ca-92e7-3ef638f183c1 with scrape type 2
2026-03-30 07:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d4835dcf-f181-50ca-92e7-3ef638f183c1, identifier: FM69133
2026-03-30 07:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d4835dcf-f181-50ca-92e7-3ef638f183c1 with identifier: FM69133
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 07:01:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d4835dcf-f181-50ca-92e7-3ef638f183c1 with identifier: FM69133
2026-03-30 07:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d4835dcf-f181-50ca-92e7-3ef638f183c1 with identifier: FM69133 to the API
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 275,
'expiration_date': '2026-03-31T15:17:33Z',
'fuel_type': 'diesel',
'id': 'd4835dcf-f181-50ca-92e7-3ef638f183c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM69133',
'listing': 'auction',
'make': 'Maserati',
'model': 'Ghibli',
'odometer': 205332,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-08',
'seller_name': None,
'title': 'Maserati Ghibli 3.0 V6 Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM69133%27 HTTP/1.1" 200 None
2026-03-30 07:01:07 [auto1.nl] INFO: Saving data for FM69133: {'auction_closing_time': 1774970253.0, 'created_time': 1774292561.814328, 'last_price_update_time': 1774854067.701071}
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FM69133') HTTP/1.1" 204 0
2026-03-30 07:01:07 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-30 07:01:07 [auto1.nl] INFO: Found listing with ID: MX79285
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX79285%27 HTTP/1.1" 200 None
2026-03-30 07:01:07 [auto1.nl] INFO: Scrape type for MX79285: 2
2026-03-30 07:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81613c29-762a-5809-a40f-e62cd3dac9c7 with identifier: MX79285
2026-03-30 07:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81613c29-762a-5809-a40f-e62cd3dac9c7 with scrape type 2
2026-03-30 07:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81613c29-762a-5809-a40f-e62cd3dac9c7 with scrape type 2
2026-03-30 07:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 81613c29-762a-5809-a40f-e62cd3dac9c7, identifier: MX79285
2026-03-30 07:01:07 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 4 pages/min), scraped 8 items (at 8 items/min)
2026-03-30 07:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-30 07:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 81613c29-762a-5809-a40f-e62cd3dac9c7 with identifier: MX79285
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 07:01:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 81613c29-762a-5809-a40f-e62cd3dac9c7 with identifier: MX79285
2026-03-30 07:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 81613c29-762a-5809-a40f-e62cd3dac9c7 with identifier: MX79285 to the API
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-31T15:42:19Z',
'fuel_type': 'electro',
'id': '81613c29-762a-5809-a40f-e62cd3dac9c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX79285',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'ID.3',
'odometer': 205361,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-29',
'seller_name': None,
'title': 'Volkswagen ID.3 electric drive 150 kW 1st Plus Pro Performance',
'transmission': 'automatic',
'trim': '1st Plus Pro Performance',
'year': 2020}
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX79285%27 HTTP/1.1" 200 None
2026-03-30 07:01:08 [auto1.nl] INFO: Saving data for MX79285: {'auction_closing_time': 1774971739.0, 'created_time': 1773134364.814973, 'last_price_update_time': 1774854068.369494}
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX79285') HTTP/1.1" 204 0
2026-03-30 07:01:08 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-30 07:01:08 [auto1.nl] INFO: Scrape type for LT65669: 2
2026-03-30 07:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b689a036-6f9c-571a-bd90-1094ac234281 with identifier: LT65669
2026-03-30 07:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b689a036-6f9c-571a-bd90-1094ac234281 with scrape type 2
2026-03-30 07:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b689a036-6f9c-571a-bd90-1094ac234281 with scrape type 2
2026-03-30 07:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b689a036-6f9c-571a-bd90-1094ac234281, identifier: LT65669
2026-03-30 07:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b689a036-6f9c-571a-bd90-1094ac234281 with identifier: LT65669
2026-03-30 07:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b689a036-6f9c-571a-bd90-1094ac234281 with identifier: LT65669
2026-03-30 07:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b689a036-6f9c-571a-bd90-1094ac234281 with identifier: LT65669 to the API
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:23:09Z',
'fuel_type': 'petrol',
'id': 'b689a036-6f9c-571a-bd90-1094ac234281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT65669',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 212084,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-12',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBoost ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2020}
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-30 07:01:08 [auto1.nl] INFO: Saving data for LT65669: {'auction_closing_time': 1774970589.0, 'created_time': 1773131914.329328, 'last_price_update_time': 1774854068.894551}
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT65669') HTTP/1.1" 204 0
2026-03-30 07:01:08 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-30 07:01:08 [auto1.nl] INFO: Scrape type for YD79188: 2
2026-03-30 07:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18414057-f9ff-588c-941e-7fe97a82144f with identifier: YD79188
2026-03-30 07:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18414057-f9ff-588c-941e-7fe97a82144f with scrape type 2
2026-03-30 07:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18414057-f9ff-588c-941e-7fe97a82144f with scrape type 2
2026-03-30 07:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 18414057-f9ff-588c-941e-7fe97a82144f, identifier: YD79188
2026-03-30 07:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 18414057-f9ff-588c-941e-7fe97a82144f with identifier: YD79188
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 07:01:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 18414057-f9ff-588c-941e-7fe97a82144f with identifier: YD79188
2026-03-30 07:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 18414057-f9ff-588c-941e-7fe97a82144f with identifier: YD79188 to the API
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:46:22Z',
'fuel_type': 'petrol',
'id': '18414057-f9ff-588c-941e-7fe97a82144f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD79188',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 166849,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-26',
'seller_name': None,
'title': 'Audi A5 Sportback 1.8 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-30 07:01:09 [auto1.nl] INFO: Saving data for YD79188: {'auction_closing_time': 1774971982.0, 'created_time': 1773131879.283355, 'last_price_update_time': 1774854069.567994}
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YD79188') HTTP/1.1" 204 0
2026-03-30 07:01:09 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-30 07:01:09 [auto1.nl] INFO: Scrape type for RG26073: 2
2026-03-30 07:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with identifier: RG26073
2026-03-30 07:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with scrape type 2
2026-03-30 07:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with scrape type 2
2026-03-30 07:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc, identifier: RG26073
2026-03-30 07:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with identifier: RG26073
2026-03-30 07:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with identifier: RG26073
2026-03-30 07:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with identifier: RG26073 to the API
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 306,
'expiration_date': '2026-03-31T15:14:21Z',
'fuel_type': 'electro',
'id': '767fec7e-b69c-5cf3-b20a-8d2b9ce871dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG26073',
'listing': 'auction',
'make': 'Tesla',
'model': 'Model 3',
'odometer': 159395,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'Tesla Model 3 Standard Range Plus',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Saving data for RG26073: {'auction_closing_time': 1774970061.0, 'created_time': 1774440104.302326, 'last_price_update_time': 1774854070.032907}
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RG26073') HTTP/1.1" 204 0
2026-03-30 07:01:10 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: WA03298
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA03298%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for WA03298: 1
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: UR49266
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: ZG07781
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG07781%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for ZG07781: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: NC71096
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC71096%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for NC71096: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: FV06268
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV06268%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for FV06268: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: UD25640
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: YL18933
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YL18933%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for YL18933: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: TN50119
2026-03-30 07:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: LA89986
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA89986%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for LA89986: 1
2026-03-30 07:01:10 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/TN50119/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: YV69069
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV69069%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for YV69069: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: MU90689
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU90689%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for MU90689: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: MR60949
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR60949%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for MR60949: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: VF08835
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: FM69133
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM69133%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for FM69133: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: MX79285
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX79285%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for MX79285: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for LT65669: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for YD79188: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for RG26073: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: WA03298
2026-03-30 07:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: FA90105
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: EL19724
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for DA42701: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for WC63917: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: LA89986
2026-03-30 07:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN50119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: FA90105
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: EL19724
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for DA42701: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for WC63917: 0
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-30 07:01:10 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-30 07:01:10 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-30 07:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA03298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA89986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN50119> (referer: https://www.auto1.com/v1/car-details-view/TN50119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ae60c66-0e9c-51a9-a89d-d774daa08f15 with identifier: TN50119
2026-03-30 07:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15 with scrape type 1
2026-03-30 07:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15
2026-03-30 07:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_c45add9fbc7966abed759a6c7eb7a5f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_c45add9fbc7966abed759a6c7eb7a5f1.jpg not downloaded yet
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_c13c6942311f2b211467d36fc11283ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_c13c6942311f2b211467d36fc11283ec.jpg not downloaded yet
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_6d40891e7786109c2063ed1f79ef07fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_6d40891e7786109c2063ed1f79ef07fd.jpg not downloaded yet
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_d77670712ac1d46b7fde6482cab92b1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_d77670712ac1d46b7fde6482cab92b1b.jpg not downloaded yet
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_874ea8b83e4031695f8af347a768c71f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_874ea8b83e4031695f8af347a768c71f.jpg not downloaded yet
2026-03-30 07:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_6d40891e7786109c2063ed1f79ef07fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_c13c6942311f2b211467d36fc11283ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_d77670712ac1d46b7fde6482cab92b1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_c45add9fbc7966abed759a6c7eb7a5f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA03298> (referer: https://www.auto1.com/v1/car-details-view/WA03298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2aba52b8d0>
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_6d40891e7786109c2063ed1f79ef07fd.jpg') HTTP/1.1" 204 0
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_6d40891e7786109c2063ed1f79ef07fd.jpg saved to cache
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15
2026-03-30 07:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_874ea8b83e4031695f8af347a768c71f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2aba631cd0>
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_c13c6942311f2b211467d36fc11283ec.jpg') HTTP/1.1" 204 0
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_c13c6942311f2b211467d36fc11283ec.jpg saved to cache
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2aba5d9310>
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_d77670712ac1d46b7fde6482cab92b1b.jpg') HTTP/1.1" 204 0
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_d77670712ac1d46b7fde6482cab92b1b.jpg saved to cache
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2aba5e2a50>
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_c45add9fbc7966abed759a6c7eb7a5f1.jpg') HTTP/1.1" 204 0
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_c45add9fbc7966abed759a6c7eb7a5f1.jpg saved to cache
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15
2026-03-30 07:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56935192-8950-5e42-b221-794f3b3de04d with identifier: WA03298
2026-03-30 07:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56935192-8950-5e42-b221-794f3b3de04d with scrape type 1
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 56935192-8950-5e42-b221-794f3b3de04d
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0558b3ffa04cac2b70f741c01d1dd%252Fpa%252FWA03298_1064748823468d6b9e3f645eb7f3f887.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_1064748823468d6b9e3f645eb7f3f887.jpg already downloaded
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0558b3ffa04cac2b70f741c01d1dd%252Fpa%252FWA03298_cee7247e3fa8beef855b25e86b26df58.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_cee7247e3fa8beef855b25e86b26df58.jpg already downloaded
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0558b3ffa04cac2b70f741c01d1dd%252Fpa%252FWA03298_c375c52cff40860952bb8907ff9cc3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_c375c52cff40860952bb8907ff9cc3ac.jpg already downloaded
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0558b3ffa04cac2b70f741c01d1dd%252Fpa%252FWA03298_1639c86a5e0155aa6ce13744d3762ead.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_1639c86a5e0155aa6ce13744d3762ead.jpg already downloaded
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0558b3ffa04cac2b70f741c01d1dd%252Fpa%252FWA03298_8a064de47c2d3ac07540768245902554.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_8a064de47c2d3ac07540768245902554.jpg already downloaded
2026-03-30 07:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56935192-8950-5e42-b221-794f3b3de04d, identifier: WA03298
2026-03-30 07:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56935192-8950-5e42-b221-794f3b3de04d with identifier: WA03298
2026-03-30 07:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56935192-8950-5e42-b221-794f3b3de04d with identifier: WA03298
2026-03-30 07:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56935192-8950-5e42-b221-794f3b3de04d with identifier: WA03298 to the API
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA03298>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:25:23Z',
'fuel_type': 'diesel',
'id': '56935192-8950-5e42-b221-794f3b3de04d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': '54PZR9',
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA03298',
'listing': 'auction',
'location': 'NL, Oosterhout',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 248196,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_1064748823468d6b9e3f645eb7f3f887.jpg',
'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_cee7247e3fa8beef855b25e86b26df58.jpg',
'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_c375c52cff40860952bb8907ff9cc3ac.jpg',
'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_1639c86a5e0155aa6ce13744d3762ead.jpg',
'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_8a064de47c2d3ac07540768245902554.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56935192-8950-5e42-b221-794f3b3de04d/56935192-8950-5e42-b221-794f3b3de04d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_1064748823468d6b9e3f645eb7f3f887.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56935192-8950-5e42-b221-794f3b3de04d/56935192-8950-5e42-b221-794f3b3de04d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_cee7247e3fa8beef855b25e86b26df58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56935192-8950-5e42-b221-794f3b3de04d/56935192-8950-5e42-b221-794f3b3de04d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_c375c52cff40860952bb8907ff9cc3ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56935192-8950-5e42-b221-794f3b3de04d/56935192-8950-5e42-b221-794f3b3de04d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_1639c86a5e0155aa6ce13744d3762ead.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56935192-8950-5e42-b221-794f3b3de04d/56935192-8950-5e42-b221-794f3b3de04d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0558b3ffa04cac2b70f741c01d1dd/pa/WA03298_8a064de47c2d3ac07540768245902554.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-18',
'seats_number': 4,
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.3 JTDM Turismo',
'transmission': 'manual',
'trim': 'Turismo',
'year': 2011}
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA03298%27 HTTP/1.1" 200 None
2026-03-30 07:01:14 [auto1.nl] INFO: Saving data for WA03298: {'created_time': 1774854074.49841, 'last_price_update_time': 1774854074.498422, 'auction_closing_time': 1774970723.0}
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WA03298') HTTP/1.1" 204 0
2026-03-30 07:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA89986> (referer: https://www.auto1.com/v1/car-details-view/LA89986/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2abd3c2a50>
2026-03-30 07:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fae%252F5caec57edd17870b673802a9ff53587e%252Fpa%252FTN50119_874ea8b83e4031695f8af347a768c71f.jpg') HTTP/1.1" 204 0
2026-03-30 07:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_874ea8b83e4031695f8af347a768c71f.jpg saved to cache
2026-03-30 07:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15
2026-03-30 07:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ae60c66-0e9c-51a9-a89d-d774daa08f15, skipping ID generation
2026-03-30 07:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15 with scrape type 1
2026-03-30 07:01:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ae60c66-0e9c-51a9-a89d-d774daa08f15 sending to next pipeline
2026-03-30 07:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ae60c66-0e9c-51a9-a89d-d774daa08f15, identifier: TN50119
2026-03-30 07:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ae60c66-0e9c-51a9-a89d-d774daa08f15 with identifier: TN50119
2026-03-30 07:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ae60c66-0e9c-51a9-a89d-d774daa08f15 with identifier: TN50119
2026-03-30 07:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ae60c66-0e9c-51a9-a89d-d774daa08f15 with identifier: TN50119 to the API
2026-03-30 07:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_874ea8b83e4031695f8af347a768c71f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:59:43Z',
'fuel_type': 'diesel',
'id': '7ae60c66-0e9c-51a9-a89d-d774daa08f15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': '2VHR11',
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN50119',
'listing': 'auction',
'location': 'NL, Alkmaar',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 135578,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_c45add9fbc7966abed759a6c7eb7a5f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_c13c6942311f2b211467d36fc11283ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_6d40891e7786109c2063ed1f79ef07fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_d77670712ac1d46b7fde6482cab92b1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae60c66-0e9c-51a9-a89d-d774daa08f15/7ae60c66-0e9c-51a9-a89d-d774daa08f15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/ae/5caec57edd17870b673802a9ff53587e/pa/TN50119_874ea8b83e4031695f8af347a768c71f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-06-24',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Rapid Maxi Extra',
'transmission': 'manual',
'trim': 'Rapid Maxi Extra',
'year': 2010}
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN50119%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [auto1.nl] INFO: Saving data for TN50119: {'created_time': 1774854075.198688, 'last_price_update_time': 1774854075.1987, 'auction_closing_time': 1774972783.0}
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN50119') HTTP/1.1" 204 0
2026-03-30 07:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f198781-a96f-5279-901e-f73f8b2187c8 with identifier: LA89986
2026-03-30 07:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f198781-a96f-5279-901e-f73f8b2187c8 with scrape type 1
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f198781-a96f-5279-901e-f73f8b2187c8
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_4b26cf9a6dedee0e4733f43932ebfcef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_4b26cf9a6dedee0e4733f43932ebfcef.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_b329ff986b61f66d4f058ded0932aaaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_b329ff986b61f66d4f058ded0932aaaa.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_9f4f67eb9e0297b4b2b58cd319a2ad28.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_9f4f67eb9e0297b4b2b58cd319a2ad28.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_6d5539f56ffa617c08547f43fe17ecfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_6d5539f56ffa617c08547f43fe17ecfd.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_19248737f054492ef158ec93847985ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_19248737f054492ef158ec93847985ab.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_5567a78cd79d2cdbcd882b1cadeb00e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_5567a78cd79d2cdbcd882b1cadeb00e8.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_760ebfe60138c29863a49b2defccf4f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_760ebfe60138c29863a49b2defccf4f6.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_09b5f648292f9078d817c163847777ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_09b5f648292f9078d817c163847777ed.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_59923d7cda5d93deba0a2d9f16d62c58.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_59923d7cda5d93deba0a2d9f16d62c58.jpg already downloaded
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fd6%252F6fd6002881913c943b370bc0af16ba97%252Fpa%252FLA89986_dbb78e0b7c1e8bfd569144aae6941433.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_dbb78e0b7c1e8bfd569144aae6941433.jpg already downloaded
2026-03-30 07:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1f198781-a96f-5279-901e-f73f8b2187c8, identifier: LA89986
2026-03-30 07:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1f198781-a96f-5279-901e-f73f8b2187c8 with identifier: LA89986
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 07:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1f198781-a96f-5279-901e-f73f8b2187c8 with identifier: LA89986
2026-03-30 07:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1f198781-a96f-5279-901e-f73f8b2187c8 with identifier: LA89986 to the API
2026-03-30 07:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA89986>
{'auction_title': '',
'c_o_2_emission_value': 40,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 218,
'expiration_date': '2026-03-31T15:13:24Z',
'fuel_type': 'hybrid',
'id': '1f198781-a96f-5279-901e-f73f8b2187c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KZ356P',
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA89986',
'listing': 'auction',
'location': 'NL, Oosterhout',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 190499,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_4b26cf9a6dedee0e4733f43932ebfcef.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_b329ff986b61f66d4f058ded0932aaaa.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_9f4f67eb9e0297b4b2b58cd319a2ad28.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_6d5539f56ffa617c08547f43fe17ecfd.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_19248737f054492ef158ec93847985ab.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_5567a78cd79d2cdbcd882b1cadeb00e8.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_760ebfe60138c29863a49b2defccf4f6.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_09b5f648292f9078d817c163847777ed.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_59923d7cda5d93deba0a2d9f16d62c58.jpg',
'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_dbb78e0b7c1e8bfd569144aae6941433.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_4b26cf9a6dedee0e4733f43932ebfcef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_b329ff986b61f66d4f058ded0932aaaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_9f4f67eb9e0297b4b2b58cd319a2ad28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_6d5539f56ffa617c08547f43fe17ecfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_19248737f054492ef158ec93847985ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_5567a78cd79d2cdbcd882b1cadeb00e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_760ebfe60138c29863a49b2defccf4f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_09b5f648292f9078d817c163847777ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_59923d7cda5d93deba0a2d9f16d62c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f198781-a96f-5279-901e-f73f8b2187c8/1f198781-a96f-5279-901e-f73f8b2187c8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/d6/6fd6002881913c943b370bc0af16ba97/pa/LA89986_dbb78e0b7c1e8bfd569144aae6941433.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 1.4 GTE',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-30 07:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA89986%27 HTTP/1.1" 200 None
2026-03-30 07:01:16 [auto1.nl] INFO: Saving data for LA89986: {'created_time': 1774854076.579646, 'last_price_update_time': 1774854076.579658, 'auction_closing_time': 1774970004.0}
2026-03-30 07:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA89986') HTTP/1.1" 204 0
2026-03-30 07:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:18 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for HK88309: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for FB29349: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for TM57044: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for NG83103: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for MW44280: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for BN75332: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for DW37625: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for CE26691: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for GR22460: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for WM06162: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for CP88423: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for FW01389: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE59902%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for UE59902: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for DS12539: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH12020%27 HTTP/1.1" 200 None
2026-03-30 07:01:18 [auto1.nl] INFO: Scrape type for LH12020: 0
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-30 07:01:18 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-30 07:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:19 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:19 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-30 07:01:19 [auto1.nl] INFO: Scrape type for JF28004: 0
2026-03-30 07:01:19 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-30 07:01:19 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-30 07:01:19 [auto1.nl] INFO: Scrape type for ZE22789: 0
2026-03-30 07:01:19 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-30 07:01:19 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-30 07:01:19 [auto1.nl] INFO: Scrape type for LW17731: 0
2026-03-30 07:01:19 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-30 07:01:19 [auto1.nl] INFO: Scrape type for YE49757: 0
2026-03-30 07:01:19 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU83484%27 HTTP/1.1" 200 None
2026-03-30 07:01:19 [auto1.nl] INFO: Scrape type for XU83484: 0
2026-03-30 07:01:19 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for AJ89396: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for MW67597: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS28591%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for SS28591: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ12615%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for DJ12615: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS78045%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for FS78045: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF33290%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for FF33290: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for MB43165: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK68166%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for DK68166: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for WM74497: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS47079%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for PS47079: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV31817%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for EV31817: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH55431%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for KH55431: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG10969%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for EG10969: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for RC67109: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE96226%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for KE96226: 0
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-30 07:01:20 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW61331%27 HTTP/1.1" 200 None
2026-03-30 07:01:20 [auto1.nl] INFO: Scrape type for VW61331: 0
2026-03-30 07:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:21 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for DF82688: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE71777%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for UE71777: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for HV97203: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for UC71604: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for HF10176: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG79878%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for UG79878: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for RL18676: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for FD60498: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW54855%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for GW54855: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for XJ86601: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for FT93592: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT87192%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for TT87192: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for EP75091: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for PT29526: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for LT58475: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for ZU81802: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for AR18023: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for VV23298: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for TA68954: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for MC92565: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-30 07:01:21 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-30 07:01:21 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-30 07:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:23 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-30 07:01:23 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Scrape type for KZ09082: 2
2026-03-30 07:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-30 07:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with scrape type 2
2026-03-30 07:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with scrape type 2
2026-03-30 07:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04bb139e-4ba8-5b53-8e2a-f325bcea1619, identifier: KZ09082
2026-03-30 07:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-30 07:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-30 07:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082 to the API
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:40:42Z',
'fuel_type': 'petrol',
'id': '04bb139e-4ba8-5b53-8e2a-f325bcea1619',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ09082',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 196832,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seller_name': None,
'title': 'Opel Astra 1.0 Turbo ON Start/Stop',
'transmission': 'manual',
'trim': 'ON Start/Stop',
'year': 2018}
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-30 07:01:23 [auto1.nl] INFO: Saving data for KZ09082: {'auction_closing_time': 1774885242.0, 'created_time': 1774551743.047535, 'last_price_update_time': 1774854083.989004}
2026-03-30 07:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ09082') HTTP/1.1" 204 0
2026-03-30 07:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:24 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-30 07:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-30 07:01:24 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-30 07:01:24 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-30 07:01:24 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-30 07:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-30 07:01:24 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-30 07:01:24 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-30 07:01:24 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-30 07:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-30 07:01:24 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-30 07:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:25 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:25 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-30 07:01:25 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-30 07:01:25 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-30 07:01:25 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-30 07:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-30 07:01:25 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-30 07:01:25 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-30 07:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-30 07:01:25 [auto1.nl] INFO: Scrape type for VJ06664: 2
2026-03-30 07:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-30 07:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b92ad5-3716-5892-9868-65c8b7f4ef54 with scrape type 2
2026-03-30 07:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56b92ad5-3716-5892-9868-65c8b7f4ef54 with scrape type 2
2026-03-30 07:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56b92ad5-3716-5892-9868-65c8b7f4ef54, identifier: VJ06664
2026-03-30 07:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-30 07:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-30 07:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664 to the API
2026-03-30 07:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:22:10Z',
'fuel_type': 'petrol',
'id': '56b92ad5-3716-5892-9868-65c8b7f4ef54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ06664',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 205142,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-13',
'seller_name': None,
'title': 'Seat Leon 1.0 TSI Style Ecomotive',
'transmission': 'manual',
'trim': 'Style Ecomotive',
'year': 2015}
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Saving data for VJ06664: {'auction_closing_time': 1774884130.0, 'created_time': 1774551745.270679, 'last_price_update_time': 1774854086.079967}
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VJ06664') HTTP/1.1" 204 0
2026-03-30 07:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for ET47420: 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for FP10265: 2
2026-03-30 07:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-30 07:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ecd506-7c44-5c1c-acff-874e7fe5348e with scrape type 2
2026-03-30 07:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ecd506-7c44-5c1c-acff-874e7fe5348e with scrape type 2
2026-03-30 07:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02ecd506-7c44-5c1c-acff-874e7fe5348e, identifier: FP10265
2026-03-30 07:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-30 07:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-30 07:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265 to the API
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:09:44Z',
'fuel_type': 'petrol',
'id': '02ecd506-7c44-5c1c-acff-874e7fe5348e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP10265',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 140399,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-27',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2015}
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Saving data for FP10265: {'auction_closing_time': 1774883384.0, 'created_time': 1774551686.012455, 'last_price_update_time': 1774854086.582021}
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP10265') HTTP/1.1" 204 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-30 07:01:26 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-30 07:01:26 [auto1.nl] INFO: Scrape type for PY50820: 2
2026-03-30 07:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-30 07:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf92713-ab07-5644-a46f-ff781cdc5926 with scrape type 2
2026-03-30 07:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf92713-ab07-5644-a46f-ff781cdc5926 with scrape type 2
2026-03-30 07:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: acf92713-ab07-5644-a46f-ff781cdc5926, identifier: PY50820
2026-03-30 07:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-30 07:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-30 07:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820 to the API
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:28:20Z',
'fuel_type': 'petrol',
'id': 'acf92713-ab07-5644-a46f-ff781cdc5926',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY50820',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 197757,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-11',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Saving data for PY50820: {'auction_closing_time': 1774884500.0, 'created_time': 1774551764.59255, 'last_price_update_time': 1774854087.193684}
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY50820') HTTP/1.1" 204 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for MB44193: 2
2026-03-30 07:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-30 07:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0aa2321-5a6a-5140-a6b9-eda5979076f8 with scrape type 2
2026-03-30 07:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0aa2321-5a6a-5140-a6b9-eda5979076f8 with scrape type 2
2026-03-30 07:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0aa2321-5a6a-5140-a6b9-eda5979076f8, identifier: MB44193
2026-03-30 07:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-30 07:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-30 07:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193 to the API
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:10:44Z',
'fuel_type': 'petrol',
'id': 'f0aa2321-5a6a-5140-a6b9-eda5979076f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB44193',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 151351,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-31',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
'transmission': 'automatic',
'trim': 'Lounge BlueMotion Tech.',
'year': 2015}
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Saving data for MB44193: {'auction_closing_time': 1774883444.0, 'created_time': 1774551711.717702, 'last_price_update_time': 1774854087.680843}
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB44193') HTTP/1.1" 204 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for VM45476: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-30 07:01:27 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-30 07:01:27 [auto1.nl] INFO: Scrape type for CF65603: 2
2026-03-30 07:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-30 07:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6324a6d6-438e-50e6-a90d-82c21e38832e with scrape type 2
2026-03-30 07:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6324a6d6-438e-50e6-a90d-82c21e38832e with scrape type 2
2026-03-30 07:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6324a6d6-438e-50e6-a90d-82c21e38832e, identifier: CF65603
2026-03-30 07:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-30 07:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-30 07:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603 to the API
2026-03-30 07:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:41:07Z',
'fuel_type': 'hybrid',
'id': '6324a6d6-438e-50e6-a90d-82c21e38832e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF65603',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 193306,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-07',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI iV RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2021}
2026-03-30 07:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-30 07:01:28 [auto1.nl] INFO: Saving data for CF65603: {'auction_closing_time': 1774885267.0, 'created_time': 1774551739.185534, 'last_price_update_time': 1774854088.298275}
2026-03-30 07:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF65603') HTTP/1.1" 204 0
2026-03-30 07:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:29 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for SE99372: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-30 07:01:29 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Scrape type for MD48743: 2
2026-03-30 07:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-30 07:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c02319c7-2ebf-5420-b7a4-cd9ece6d95de with scrape type 2
2026-03-30 07:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c02319c7-2ebf-5420-b7a4-cd9ece6d95de with scrape type 2
2026-03-30 07:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c02319c7-2ebf-5420-b7a4-cd9ece6d95de, identifier: MD48743
2026-03-30 07:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-30 07:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-30 07:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743 to the API
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:17:29Z',
'fuel_type': 'hybrid',
'id': 'c02319c7-2ebf-5420-b7a4-cd9ece6d95de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD48743',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 198005,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-31',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 GTE',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-30 07:01:29 [auto1.nl] INFO: Saving data for MD48743: {'auction_closing_time': 1774883849.0, 'created_time': 1774551763.808433, 'last_price_update_time': 1774854089.944034}
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD48743') HTTP/1.1" 204 0
2026-03-30 07:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-30 07:01:30 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-30 07:01:30 [auto1.nl] INFO: Scrape type for GW56825: 2
2026-03-30 07:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-30 07:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0d4bc6-5221-5ed1-a467-12223b37b200 with scrape type 2
2026-03-30 07:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0d4bc6-5221-5ed1-a467-12223b37b200 with scrape type 2
2026-03-30 07:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c0d4bc6-5221-5ed1-a467-12223b37b200, identifier: GW56825
2026-03-30 07:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-30 07:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-30 07:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825 to the API
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:32:17Z',
'fuel_type': 'petrol',
'id': '3c0d4bc6-5221-5ed1-a467-12223b37b200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW56825',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 65653,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-14',
'seller_name': None,
'title': 'Peugeot 3008 1.6 THP Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2011}
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-30 07:01:30 [auto1.nl] INFO: Saving data for GW56825: {'auction_closing_time': 1774884737.0, 'created_time': 1773131953.305068, 'last_price_update_time': 1774854090.484208}
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW56825') HTTP/1.1" 204 0
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-30 07:01:30 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-30 07:01:30 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-30 07:01:30 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-30 07:01:30 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-30 07:01:30 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-30 07:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:31 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:31 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-30 07:01:31 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-30 07:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-30 07:01:31 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-30 07:01:31 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-30 07:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-30 07:01:31 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-30 07:01:31 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-30 07:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-30 07:01:31 [auto1.nl] INFO: Scrape type for CM82546: 2
2026-03-30 07:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-30 07:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133c9cb0-e881-5240-b8eb-788fa3c341b6 with scrape type 2
2026-03-30 07:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 133c9cb0-e881-5240-b8eb-788fa3c341b6 with scrape type 2
2026-03-30 07:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 133c9cb0-e881-5240-b8eb-788fa3c341b6, identifier: CM82546
2026-03-30 07:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-30 07:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-30 07:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546 to the API
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:06:30Z',
'fuel_type': 'petrol',
'id': '133c9cb0-e881-5240-b8eb-788fa3c341b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM82546',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 230495,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-03-06',
'seller_name': None,
'title': 'BMW 3er 325i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2006}
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Saving data for CM82546: {'auction_closing_time': 1774883190.0, 'created_time': 1774551704.471483, 'last_price_update_time': 1774854092.479007}
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM82546') HTTP/1.1" 204 0
2026-03-30 07:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for HX69861: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-30 07:01:32 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-30 07:01:32 [auto1.nl] INFO: Scrape type for CL96583: 2
2026-03-30 07:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-30 07:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1692a952-d16e-5319-b4b5-5c957492c775 with scrape type 2
2026-03-30 07:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1692a952-d16e-5319-b4b5-5c957492c775 with scrape type 2
2026-03-30 07:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1692a952-d16e-5319-b4b5-5c957492c775, identifier: CL96583
2026-03-30 07:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 07:01:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-30 07:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583 to the API
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 173,
'expiration_date': '2026-03-30T15:12:43Z',
'fuel_type': 'petrol',
'id': '1692a952-d16e-5319-b4b5-5c957492c775',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL96583',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Santa Fe',
'odometer': 160186,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-10-15',
'seller_name': None,
'title': 'Hyundai Santa Fe 2.7 V6 GLS',
'transmission': 'automatic',
'trim': 'GLS',
'year': 2002}
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Saving data for CL96583: {'auction_closing_time': 1774883563.0, 'created_time': 1774551746.138415, 'last_price_update_time': 1774854093.332273}
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CL96583') HTTP/1.1" 204 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-30 07:01:33 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-30 07:01:33 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-30 07:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:34 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-30 07:01:34 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-30 07:01:34 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-30 07:01:34 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-30 07:01:34 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-30 07:01:34 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-30 07:01:34 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-30 07:01:34 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-30 07:01:34 [auto1.nl] INFO: Scrape type for MX82019: 2
2026-03-30 07:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-30 07:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88ee384-b91f-5b59-a7d9-8d318cb9e052 with scrape type 2
2026-03-30 07:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88ee384-b91f-5b59-a7d9-8d318cb9e052 with scrape type 2
2026-03-30 07:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f88ee384-b91f-5b59-a7d9-8d318cb9e052, identifier: MX82019
2026-03-30 07:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-30 07:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 07:01:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-30 07:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019 to the API
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 103,
'expiration_date': '2026-03-30T15:35:07Z',
'fuel_type': 'petrol',
'id': 'f88ee384-b91f-5b59-a7d9-8d318cb9e052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX82019',
'listing': 'auction',
'make': 'Lancia',
'model': 'Delta',
'odometer': 214768,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-08-26',
'seller_name': None,
'title': 'Lancia Delta 1.6 HPE',
'transmission': 'manual',
'trim': 'HPE',
'year': 1999}
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-30 07:01:35 [auto1.nl] INFO: Saving data for MX82019: {'auction_closing_time': 1774884907.0, 'created_time': 1774551749.529035, 'last_price_update_time': 1774854095.503772}
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX82019') HTTP/1.1" 204 0
2026-03-30 07:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:35 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-30 07:01:35 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-30 07:01:35 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-30 07:01:35 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-30 07:01:35 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-30 07:01:35 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-30 07:01:35 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-30 07:01:35 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-30 07:01:35 [auto1.nl] INFO: Scrape type for NK23750: 2
2026-03-30 07:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-30 07:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 022e46ed-f385-5f97-9025-5398e8a74e7f with scrape type 2
2026-03-30 07:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 022e46ed-f385-5f97-9025-5398e8a74e7f with scrape type 2
2026-03-30 07:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 022e46ed-f385-5f97-9025-5398e8a74e7f, identifier: NK23750
2026-03-30 07:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-30 07:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-30 07:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750 to the API
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:49:20Z',
'fuel_type': 'petrol',
'id': '022e46ed-f385-5f97-9025-5398e8a74e7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK23750',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 102673,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-02',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-30 07:01:36 [auto1.nl] INFO: Saving data for NK23750: {'auction_closing_time': 1774885760.0, 'created_time': 1774551765.94995, 'last_price_update_time': 1774854096.051742}
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NK23750') HTTP/1.1" 204 0
2026-03-30 07:01:36 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-30 07:01:36 [auto1.nl] INFO: Scrape type for LT61011: 2
2026-03-30 07:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-30 07:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 895f6ddb-d43d-5cb7-acbc-65874857d224 with scrape type 2
2026-03-30 07:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 895f6ddb-d43d-5cb7-acbc-65874857d224 with scrape type 2
2026-03-30 07:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 895f6ddb-d43d-5cb7-acbc-65874857d224, identifier: LT61011
2026-03-30 07:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-30 07:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-30 07:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011 to the API
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:14:45Z',
'fuel_type': 'diesel',
'id': '895f6ddb-d43d-5cb7-acbc-65874857d224',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT61011',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 77777,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-01',
'seller_name': None,
'title': 'Mercedes-Benz Citan 108 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2020}
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-30 07:01:36 [auto1.nl] INFO: Saving data for LT61011: {'auction_closing_time': 1774883685.0, 'created_time': 1774551751.131415, 'last_price_update_time': 1774854096.446534}
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT61011') HTTP/1.1" 204 0
2026-03-30 07:01:36 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-30 07:01:36 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-30 07:01:36 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-30 07:01:36 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-30 07:01:36 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-30 07:01:36 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-30 07:01:36 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-30 07:01:36 [auto1.nl] INFO: Scrape type for EK38089: 2
2026-03-30 07:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-30 07:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45020602-a651-5b28-9158-191f691320fe with scrape type 2
2026-03-30 07:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45020602-a651-5b28-9158-191f691320fe with scrape type 2
2026-03-30 07:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 45020602-a651-5b28-9158-191f691320fe, identifier: EK38089
2026-03-30 07:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-30 07:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-30 07:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089 to the API
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:11:18Z',
'fuel_type': 'petrol',
'id': '45020602-a651-5b28-9158-191f691320fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK38089',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 179285,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-11',
'seller_name': None,
'title': 'BMW 6er 640i GT xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2018}
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-30 07:01:36 [auto1.nl] INFO: Saving data for EK38089: {'auction_closing_time': 1774883478.0, 'created_time': 1774551723.723329, 'last_price_update_time': 1774854096.887613}
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK38089') HTTP/1.1" 204 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-30 07:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:37 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-30 07:01:37 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-30 07:01:37 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-30 07:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-30 07:01:38 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-30 07:01:38 [auto1.nl] INFO: Scrape type for CU35423: 2
2026-03-30 07:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-30 07:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9282a218-25b8-5356-aade-50a8a0dde52e with scrape type 2
2026-03-30 07:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9282a218-25b8-5356-aade-50a8a0dde52e with scrape type 2
2026-03-30 07:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9282a218-25b8-5356-aade-50a8a0dde52e, identifier: CU35423
2026-03-30 07:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-30 07:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-30 07:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423 to the API
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:23:03Z',
'fuel_type': 'diesel',
'id': '9282a218-25b8-5356-aade-50a8a0dde52e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU35423',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 106521,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-24',
'seller_name': None,
'title': 'Peugeot 308 2.0 HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2011}
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-30 07:01:38 [auto1.nl] INFO: Saving data for CU35423: {'auction_closing_time': 1774884183.0, 'created_time': 1774551744.548415, 'last_price_update_time': 1774854098.405238}
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CU35423') HTTP/1.1" 204 0
2026-03-30 07:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-30 07:01:38 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-30 07:01:38 [auto1.nl] INFO: Scrape type for XW28642: 0
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-30 07:01:38 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-30 07:01:38 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-30 07:01:38 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-30 07:01:38 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-30 07:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:39 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-30 07:01:39 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-30 07:01:39 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-30 07:01:39 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-30 07:01:39 [auto1.nl] INFO: Scrape type for UF74705: 0
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-30 07:01:39 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-30 07:01:39 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-30 07:01:39 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-30 07:01:39 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-30 07:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-30 07:01:40 [auto1.nl] INFO: Scrape type for EN44222: 2
2026-03-30 07:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-30 07:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with scrape type 2
2026-03-30 07:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with scrape type 2
2026-03-30 07:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd, identifier: EN44222
2026-03-30 07:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-30 07:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-30 07:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222 to the API
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:13:18Z',
'fuel_type': 'petrol',
'id': 'c5274c10-ce3f-5dfb-99be-7ac258ac4ebd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN44222',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 302205,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-19',
'seller_name': None,
'title': 'BMW 5er 535i',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-30 07:01:40 [auto1.nl] INFO: Saving data for EN44222: {'auction_closing_time': 1774883598.0, 'created_time': 1774465303.361222, 'last_price_update_time': 1774854100.432151}
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EN44222') HTTP/1.1" 204 0
2026-03-30 07:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:40 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-30 07:01:40 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-30 07:01:40 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-30 07:01:40 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-30 07:01:40 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-30 07:01:40 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-30 07:01:40 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-30 07:01:40 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-30 07:01:40 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-30 07:01:40 [auto1.nl] INFO: Scrape type for VH08569: 2
2026-03-30 07:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-30 07:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with scrape type 2
2026-03-30 07:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with scrape type 2
2026-03-30 07:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56d29233-5f25-5e4f-aa4e-14eabb0861d5, identifier: VH08569
2026-03-30 07:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-30 07:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-30 07:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569 to the API
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:57Z',
'fuel_type': 'petrol',
'id': '56d29233-5f25-5e4f-aa4e-14eabb0861d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH08569',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 121516,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-22',
'seller_name': None,
'title': 'Opel Corsa 1.4 Turbo S ecoFlex',
'transmission': 'manual',
'trim': 'S ecoFlex',
'year': 2018}
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Saving data for VH08569: {'auction_closing_time': 1774884897.0, 'created_time': 1774551754.674923, 'last_price_update_time': 1774854101.009067}
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH08569') HTTP/1.1" 204 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for AY58936: 2
2026-03-30 07:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-30 07:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d280cf38-61cc-5994-9096-9b17c21252fe with scrape type 2
2026-03-30 07:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d280cf38-61cc-5994-9096-9b17c21252fe with scrape type 2
2026-03-30 07:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d280cf38-61cc-5994-9096-9b17c21252fe, identifier: AY58936
2026-03-30 07:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-30 07:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-30 07:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936 to the API
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:20:14Z',
'fuel_type': 'petrol',
'id': 'd280cf38-61cc-5994-9096-9b17c21252fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY58936',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 174784,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-18',
'seller_name': None,
'title': 'Nissan Juke 1.6 Nismo',
'transmission': 'manual',
'trim': 'Nismo',
'year': 2014}
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Saving data for AY58936: {'auction_closing_time': 1774884014.0, 'created_time': 1774353784.375024, 'last_price_update_time': 1774854101.40338}
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY58936') HTTP/1.1" 204 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-30 07:01:41 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-30 07:01:41 [auto1.nl] INFO: Scrape type for DA29812: 2
2026-03-30 07:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-30 07:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with scrape type 2
2026-03-30 07:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with scrape type 2
2026-03-30 07:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9, identifier: DA29812
2026-03-30 07:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-30 07:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-30 07:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812 to the API
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:00:11Z',
'fuel_type': 'petrol',
'id': '119cd623-a1bd-52d3-bf5f-c55fcd9bdda9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA29812',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 35303,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-29',
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2014}
2026-03-30 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-30 07:01:42 [auto1.nl] INFO: Saving data for DA29812: {'auction_closing_time': 1774882811.0, 'created_time': 1774551752.070022, 'last_price_update_time': 1774854102.095636}
2026-03-30 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA29812') HTTP/1.1" 204 0
2026-03-30 07:01:42 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-30 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-30 07:01:42 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-30 07:01:42 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-30 07:01:42 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-30 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-30 07:01:42 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-30 07:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:44 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for AM42063: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-30 07:01:44 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-30 07:01:44 [auto1.nl] INFO: Scrape type for FH88416: 2
2026-03-30 07:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-30 07:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2944f94-8a96-50e1-9b6c-ee20ed28183f with scrape type 2
2026-03-30 07:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2944f94-8a96-50e1-9b6c-ee20ed28183f with scrape type 2
2026-03-30 07:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2944f94-8a96-50e1-9b6c-ee20ed28183f, identifier: FH88416
2026-03-30 07:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-30 07:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-30 07:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416 to the API
2026-03-30 07:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:26:36Z',
'fuel_type': 'petrol',
'id': 'f2944f94-8a96-50e1-9b6c-ee20ed28183f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH88416',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 90728,
'odometer_reading_unit': 'km',
'origin_country_code': 'NL',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-18',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2010}
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Saving data for FH88416: {'auction_closing_time': 1774884396.0, 'created_time': 1774551761.859179, 'last_price_update_time': 1774854105.176117}
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH88416') HTTP/1.1" 204 0
2026-03-30 07:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-30 07:01:45 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-30 07:01:45 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-30 07:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:46 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for LS97590: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-30 07:01:46 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-30 07:01:46 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-30 07:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for KP34214: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-30 07:01:47 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-30 07:01:47 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-30 07:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:48 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for KV59291: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-30 07:01:48 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-30 07:01:48 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-30 07:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:49 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for MX73700: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for KW64079: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for GV91252: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for VE70887: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for TY41517: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-30 07:01:49 [auto1.nl] INFO: Scrape type for WP58537: 0
2026-03-30 07:01:49 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-30 07:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-30 07:01:50 [auto1.nl] INFO: Scrape type for LE21715: 0
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-30 07:01:50 [auto1.nl] INFO: Scrape type for JH71745: 0
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-30 07:01:50 [auto1.nl] INFO: Scrape type for BL89669: 0
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-30 07:01:50 [auto1.nl] INFO: Scrape type for HN54837: 0
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-30 07:01:50 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-30 07:01:50 [auto1.nl] INFO: Scrape type for XK63885: 0
2026-03-30 07:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:51 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for BJ61509: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for RH72913: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for SR45817: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for EC40520: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for LL30088: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for SN61945: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for ZK31432: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for GN14496: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for WH58354: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for VZ88435: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK58084%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for ZK58084: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for ZN70459: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for FE67699: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for XU82529: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for VZ65695: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for GU70185: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for GD33520: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for PS01910: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for AB54003: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for HD36341: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for JA81822: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for JA39510: 0
2026-03-30 07:01:51 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-30 07:01:51 [auto1.nl] INFO: Scrape type for AD33035: 0
2026-03-30 07:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:52 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-30 07:01:52 [auto1.nl] INFO: Scrape type for NJ31093: 0
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-30 07:01:52 [auto1.nl] INFO: Scrape type for YZ13462: 0
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-30 07:01:52 [auto1.nl] INFO: Scrape type for LE06198: 0
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-30 07:01:52 [auto1.nl] INFO: Scrape type for HW32084: 0
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-30 07:01:52 [auto1.nl] INFO: Scrape type for EW29368: 0
2026-03-30 07:01:52 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for UW56966: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for YF94322: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for PK76759: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for GA63942: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for XH80509: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for ND88147: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for WE18316: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for SS74343: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for YZ60467: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for MZ09465: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for EG04578: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for PJ49676: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for TL29950: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for GZ48867: 0
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-30 07:01:53 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-30 07:01:53 [auto1.nl] INFO: Scrape type for ZB71006: 0
2026-03-30 07:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:55 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for DU11939: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for KK51574: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for AK27162: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for KX15971: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for MV10901: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for ZT51900: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for GN27243: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for NU66962: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for VY08351: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for XR71865: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for YA06880: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for SE60245: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for KL38892: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for TW61693: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for SE95402: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-30 07:01:55 [auto1.nl] INFO: Scrape type for RK78214: 0
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-30 07:01:55 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-30 07:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-30 07:01:56 [auto1.nl] INFO: Scrape type for EW45242: 0
2026-03-30 07:01:56 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-30 07:01:56 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-30 07:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-30 07:01:56 [auto1.nl] INFO: Scrape type for UA80107: 0
2026-03-30 07:01:56 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-30 07:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-30 07:01:56 [auto1.nl] INFO: Scrape type for UH76205: 0
2026-03-30 07:01:56 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-30 07:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:57 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 783 | hits on page: 40
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for KX92525: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for UU92994: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for WY17438: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for ZS54708: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for BB32456: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for WW25859: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for BP52845: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for DX51815: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for NJ12224: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for DJ46393: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for JF84007: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for KD48941: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for EU38085: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for WN94746: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for WU56616: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for CT48510: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for RD76922: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for WC26387: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for LF00808: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-30 07:01:57 [auto1.nl] INFO: Scrape type for JM92964: 0
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-30 07:01:57 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-30 07:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:01:58 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 783 | hits on page: 23
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for HJ37238: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for JK34334: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for YB88576: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for YG37971: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for UF88780: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for KC88699: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for WZ79997: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for MP39959: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for YN95467: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-30 07:01:58 [auto1.nl] INFO: Scrape type for AW17903: 0
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-30 07:01:58 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-30 07:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-30 07:01:59 [auto1.nl] INFO: Scrape type for NC22018: 0
2026-03-30 07:01:59 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-30 07:01:59 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-30 07:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-30 07:01:59 [auto1.nl] INFO: Scrape type for ZG49112: 0
2026-03-30 07:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:02:01 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 783 | hits on page: 0
2026-03-30 07:02:01 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 07:02:01 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-30 07:02:01 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 165, <ScrapeType.BATCH_SKIPPED: 5>: 158}
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774422122 HTTP/1.1" 200 None
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX15109') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP95688') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV43901') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CC13114') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP73736') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DG15583') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB40110') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH38641') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH71315') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM83384') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP19575') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EV51883') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD46259') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FZ71545') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA99853') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS18906') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HR40942') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW70134') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JV02443') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KH11500') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KM73948') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KY22626') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LV76286') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MK89382') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ07382') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX43694') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ98255') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA18069') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PL69389') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PX06576') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RR86618') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SL78250') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV08873') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TH23479') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU60674') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UD25640') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA05032') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XU01023') HTTP/1.1" 204 0
2026-03-30 07:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG81860') HTTP/1.1" 204 0
2026-03-30 07:02:02 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (35 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-30T07_00_00.jl
2026-03-30 07:02:03 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 88042,
'downloader/request_count': 36,
'downloader/request_method_count/GET': 13,
'downloader/request_method_count/POST': 23,
'downloader/response_bytes': 4028443,
'downloader/response_count': 36,
'downloader/response_status_count/200': 36,
'dupefilter/filtered': 3,
'elapsed_time_seconds': 115.449548,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 7, 2, 2, 896941, tzinfo=datetime.timezone.utc),
'item_scraped_count': 35,
'log_count/DEBUG': 1291,
'log_count/INFO': 1650,
'memusage/max': 163119104,
'memusage/startup': 149864448,
'photo_download_count': 5,
'request_depth_max': 24,
'response_received_count': 31,
'scheduler/dequeued': 36,
'scheduler/dequeued/memory': 36,
'scheduler/enqueued': 36,
'scheduler/enqueued/memory': 36,
'scrape_type/batch_skipped': 404,
'scrape_type/new': 3,
'scrape_type/price_update': 32,
'scrape_type/skipped': 381,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 31,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.1060258488981964,
'scrapy-zyte-api/mean_response_seconds': 3.207564308758706,
'scrapy-zyte-api/processed': 31,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 31,
'scrapy-zyte-api/request_args/experimental.requestCookies': 30,
'scrapy-zyte-api/request_args/experimental.responseCookies': 31,
'scrapy-zyte-api/request_args/httpRequestBody': 23,
'scrapy-zyte-api/request_args/httpRequestMethod': 23,
'scrapy-zyte-api/request_args/httpResponseBody': 31,
'scrapy-zyte-api/request_args/httpResponseHeaders': 31,
'scrapy-zyte-api/request_args/sessionContext': 31,
'scrapy-zyte-api/request_args/url': 31,
'scrapy-zyte-api/status_codes/200': 31,
'scrapy-zyte-api/success': 31,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 823,
'source/total_available': 783,
'start_time': datetime.datetime(2026, 3, 30, 7, 0, 7, 447393, tzinfo=datetime.timezone.utc)}
2026-03-30 07:02:03 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 07:02:03 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2abc537fd0>
2026-03-30 07:02:03 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2abc704410>