2026-03-29 12:10:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 12:10:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 12:10:05 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-29 12:10:05 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-29 12:10:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 12:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 12:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 12:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 12:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: 5df2c37937dcea46
2026-03-29 12:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 12:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-29T12_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 12:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 12:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 12:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 12:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 12:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 12:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 12:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-29 12:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 12:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 12:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 12:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 12:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 12:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 12:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 12:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 12:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 12:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 12:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 12:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 12:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 12:10:19 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:19 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-29 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-29 12:10:19 [auto1.nl] INFO: Scrape type for BY07410: 2
2026-03-29 12:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-29 12:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224f6637-7c71-548e-8dbe-10d58d9ac847 with scrape type 2
2026-03-29 12:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224f6637-7c71-548e-8dbe-10d58d9ac847 with scrape type 2
2026-03-29 12:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 224f6637-7c71-548e-8dbe-10d58d9ac847, identifier: BY07410
2026-03-29 12:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-29 12:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 12:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 12:10:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410
2026-03-29 12:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 224f6637-7c71-548e-8dbe-10d58d9ac847 with identifier: BY07410 to the API
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:00:38Z',
 'fuel_type': 'petrol',
 'id': '224f6637-7c71-548e-8dbe-10d58d9ac847',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY07410',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3 Cabrio',
 'odometer': 132796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Citroen DS3 Cabrio 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2013}
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-29 12:10:20 [auto1.nl] INFO: Saving data for BY07410: {'auction_closing_time': 1774882838.0, 'created_time': 1773927659.32465, 'last_price_update_time': 1774786220.445645}
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY07410') HTTP/1.1" 204 0
2026-03-29 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:20 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-29 12:10:20 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-29 12:10:20 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-29 12:10:20 [auto1.nl] INFO: Scrape type for KZ40216: 2
2026-03-29 12:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-29 12:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with scrape type 2
2026-03-29 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with scrape type 2
2026-03-29 12:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f, identifier: KZ40216
2026-03-29 12:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-29 12:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216
2026-03-29 12:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03e329dd-f4f2-54a2-af8a-dd2eded85e7f with identifier: KZ40216 to the API
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:46:49Z',
 'fuel_type': 'petrol',
 'id': '03e329dd-f4f2-54a2-af8a-dd2eded85e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ40216',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 195392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-22',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2013}
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-29 12:10:20 [auto1.nl] INFO: Saving data for KZ40216: {'auction_closing_time': 1774885609.0, 'created_time': 1773861356.385734, 'last_price_update_time': 1774786220.85792}
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ40216') HTTP/1.1" 204 0
2026-03-29 12:10:20 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-29 12:10:20 [auto1.nl] INFO: Scrape type for VD19679: 2
2026-03-29 12:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-29 12:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f8d6cd-6bff-55b1-83b0-736023b02205 with scrape type 2
2026-03-29 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f8d6cd-6bff-55b1-83b0-736023b02205 with scrape type 2
2026-03-29 12:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 97f8d6cd-6bff-55b1-83b0-736023b02205, identifier: VD19679
2026-03-29 12:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-29 12:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679
2026-03-29 12:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 97f8d6cd-6bff-55b1-83b0-736023b02205 with identifier: VD19679 to the API
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:33Z',
 'fuel_type': 'diesel',
 'id': '97f8d6cd-6bff-55b1-83b0-736023b02205',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD19679',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 233118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-29 12:10:21 [auto1.nl] INFO: Saving data for VD19679: {'auction_closing_time': 1774885353.0, 'created_time': 1774268182.880489, 'last_price_update_time': 1774786221.494669}
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD19679') HTTP/1.1" 204 0
2026-03-29 12:10:21 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-29 12:10:21 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-29 12:10:21 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-29 12:10:21 [auto1.nl] INFO: Scrape type for XW90615: 2
2026-03-29 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-29 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99928119-baaf-5c23-95e8-0856a6b17c54 with scrape type 2
2026-03-29 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99928119-baaf-5c23-95e8-0856a6b17c54 with scrape type 2
2026-03-29 12:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99928119-baaf-5c23-95e8-0856a6b17c54, identifier: XW90615
2026-03-29 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-29 12:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615
2026-03-29 12:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99928119-baaf-5c23-95e8-0856a6b17c54 with identifier: XW90615 to the API
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:36Z',
 'fuel_type': 'petrol',
 'id': '99928119-baaf-5c23-95e8-0856a6b17c54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW90615',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 124186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-14',
 'seller_name': None,
 'title': "Kia cee'd 1.6 EX",
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2008}
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-29 12:10:21 [auto1.nl] INFO: Saving data for XW90615: {'auction_closing_time': 1774885476.0, 'created_time': 1774638724.979343, 'last_price_update_time': 1774786221.906911}
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW90615') HTTP/1.1" 204 0
2026-03-29 12:10:21 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-29 12:10:21 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-29 12:10:21 [auto1.nl] INFO: Scrape type for KJ03037: 2
2026-03-29 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with identifier: KJ03037
2026-03-29 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with scrape type 2
2026-03-29 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with scrape type 2
2026-03-29 12:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4, identifier: KJ03037
2026-03-29 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with identifier: KJ03037
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with identifier: KJ03037
2026-03-29 12:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4 with identifier: KJ03037 to the API
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:41:23Z',
 'fuel_type': 'petrol',
 'id': '8b9ab9a4-c96a-5496-9ff4-1c20b9cf1bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ03037',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 132408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-09',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2006}
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-29 12:10:22 [auto1.nl] INFO: Saving data for KJ03037: {'auction_closing_time': 1774885283.0, 'created_time': 1774552351.690151, 'last_price_update_time': 1774786222.44694}
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KJ03037') HTTP/1.1" 204 0
2026-03-29 12:10:22 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-29 12:10:22 [auto1.nl] INFO: Scrape type for YC94295: 2
2026-03-29 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 082160fa-d71a-5841-a003-4e765e5910b1 with identifier: YC94295
2026-03-29 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 082160fa-d71a-5841-a003-4e765e5910b1 with scrape type 2
2026-03-29 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 082160fa-d71a-5841-a003-4e765e5910b1 with scrape type 2
2026-03-29 12:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 082160fa-d71a-5841-a003-4e765e5910b1, identifier: YC94295
2026-03-29 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 082160fa-d71a-5841-a003-4e765e5910b1 with identifier: YC94295
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 082160fa-d71a-5841-a003-4e765e5910b1 with identifier: YC94295
2026-03-29 12:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 082160fa-d71a-5841-a003-4e765e5910b1 with identifier: YC94295 to the API
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:23Z',
 'fuel_type': 'petrol',
 'id': '082160fa-d71a-5841-a003-4e765e5910b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC94295',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 227039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-04',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-29 12:10:23 [auto1.nl] INFO: Saving data for YC94295: {'auction_closing_time': 1774884863.0, 'created_time': 1773229447.655904, 'last_price_update_time': 1774786223.04641}
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YC94295') HTTP/1.1" 204 0
2026-03-29 12:10:23 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-29 12:10:23 [auto1.nl] INFO: Scrape type for PE07058: 2
2026-03-29 12:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38e57272-5be0-5234-93d3-af552ae4fa2b with identifier: PE07058
2026-03-29 12:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38e57272-5be0-5234-93d3-af552ae4fa2b with scrape type 2
2026-03-29 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38e57272-5be0-5234-93d3-af552ae4fa2b with scrape type 2
2026-03-29 12:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 38e57272-5be0-5234-93d3-af552ae4fa2b, identifier: PE07058
2026-03-29 12:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 38e57272-5be0-5234-93d3-af552ae4fa2b with identifier: PE07058
2026-03-29 12:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 38e57272-5be0-5234-93d3-af552ae4fa2b with identifier: PE07058
2026-03-29 12:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 38e57272-5be0-5234-93d3-af552ae4fa2b with identifier: PE07058 to the API
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'petrol',
 'id': '38e57272-5be0-5234-93d3-af552ae4fa2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE07058',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 130685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-29 12:10:23 [auto1.nl] INFO: Saving data for PE07058: {'auction_closing_time': 1774885961.0, 'created_time': 1774465829.812539, 'last_price_update_time': 1774786223.601726}
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PE07058') HTTP/1.1" 204 0
2026-03-29 12:10:23 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-29 12:10:23 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW98362%27 HTTP/1.1" 200 None
2026-03-29 12:10:23 [auto1.nl] INFO: Scrape type for BW98362: 1
2026-03-29 12:10:23 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-29 12:10:23 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-29 12:10:23 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-29 12:10:23 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-29 12:10:23 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-29 12:10:23 [auto1.nl] INFO: Scrape type for ZP63684: 2
2026-03-29 12:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776085b6-d397-5e9e-bd86-49f66258fcd5 with identifier: ZP63684
2026-03-29 12:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776085b6-d397-5e9e-bd86-49f66258fcd5 with scrape type 2
2026-03-29 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 776085b6-d397-5e9e-bd86-49f66258fcd5 with scrape type 2
2026-03-29 12:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 776085b6-d397-5e9e-bd86-49f66258fcd5, identifier: ZP63684
2026-03-29 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 776085b6-d397-5e9e-bd86-49f66258fcd5 with identifier: ZP63684
2026-03-29 12:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 776085b6-d397-5e9e-bd86-49f66258fcd5 with identifier: ZP63684
2026-03-29 12:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 776085b6-d397-5e9e-bd86-49f66258fcd5 with identifier: ZP63684 to the API
2026-03-29 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:03Z',
 'fuel_type': 'petrol',
 'id': '776085b6-d397-5e9e-bd86-49f66258fcd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP63684',
 'listing': 'auction',
 'make': 'MG Rover',
 'model': '75',
 'odometer': 198968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-05',
 'seller_name': None,
 'title': 'MG Rover 75 1.8 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2005}
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-29 12:10:24 [auto1.nl] INFO: Saving data for ZP63684: {'auction_closing_time': 1774886163.0, 'created_time': 1773232301.365285, 'last_price_update_time': 1774786224.113393}
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP63684') HTTP/1.1" 204 0
2026-03-29 12:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:24 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-29 12:10:24 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-29 12:10:24 [auto1.nl] INFO: Scrape type for VL80205: 2
2026-03-29 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-29 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9520c497-6ea0-5467-8437-118e03e39bc8 with scrape type 2
2026-03-29 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9520c497-6ea0-5467-8437-118e03e39bc8 with scrape type 2
2026-03-29 12:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9520c497-6ea0-5467-8437-118e03e39bc8, identifier: VL80205
2026-03-29 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205
2026-03-29 12:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9520c497-6ea0-5467-8437-118e03e39bc8 with identifier: VL80205 to the API
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:46Z',
 'fuel_type': 'petrol',
 'id': '9520c497-6ea0-5467-8437-118e03e39bc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL80205',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space',
 'odometer': 208362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-03-31',
 'seller_name': None,
 'title': 'Mitsubishi Space 2.4 GDI Motion',
 'transmission': 'manual',
 'trim': 'Motion',
 'year': 2000}
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-29 12:10:24 [auto1.nl] INFO: Saving data for VL80205: {'auction_closing_time': 1774885306.0, 'created_time': 1774638684.051377, 'last_price_update_time': 1774786224.624835}
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL80205') HTTP/1.1" 204 0
2026-03-29 12:10:24 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-29 12:10:24 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-29 12:10:24 [auto1.nl] INFO: Scrape type for FD56899: 2
2026-03-29 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-29 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9744a992-e104-5296-830e-f83dba490145 with scrape type 2
2026-03-29 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9744a992-e104-5296-830e-f83dba490145 with scrape type 2
2026-03-29 12:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9744a992-e104-5296-830e-f83dba490145, identifier: FD56899
2026-03-29 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-29 12:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899
2026-03-29 12:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9744a992-e104-5296-830e-f83dba490145 with identifier: FD56899 to the API
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:55:12Z',
 'fuel_type': 'petrol',
 'id': '9744a992-e104-5296-830e-f83dba490145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD56899',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Wagon',
 'odometer': 150881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Suzuki Wagon 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Saving data for FD56899: {'auction_closing_time': 1774886112.0, 'created_time': 1774465828.242712, 'last_price_update_time': 1774786225.045653}
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD56899') HTTP/1.1" 204 0
2026-03-29 12:10:25 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for FJ96412: 2
2026-03-29 12:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-29 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with scrape type 2
2026-03-29 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with scrape type 2
2026-03-29 12:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43, identifier: FJ96412
2026-03-29 12:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-29 12:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412
2026-03-29 12:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd56b48c-ae68-5a9f-acb0-7c2e90c15b43 with identifier: FJ96412 to the API
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:34:22Z',
 'fuel_type': 'petrol',
 'id': 'cd56b48c-ae68-5a9f-acb0-7c2e90c15b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ96412',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 155860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-25',
 'seller_name': None,
 'title': 'Peugeot 307 2.0 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2004}
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Saving data for FJ96412: {'auction_closing_time': 1774884862.0, 'created_time': 1774638700.45358, 'last_price_update_time': 1774786225.651312}
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ96412') HTTP/1.1" 204 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for XW90615: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for KJ03037: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for YC94295: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for PE07058: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-29 12:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF19474%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for YF19474: 1
2026-03-29 12:10:25 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/BW98362/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for ZP63684: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for VL80205: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for FD56899: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for FJ96412: 0
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-29 12:10:25 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-29 12:10:25 [auto1.nl] INFO: Scrape type for CN90357: 2
2026-03-29 12:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 302f3549-6a63-54d0-9729-d1b8ae33d17f with identifier: CN90357
2026-03-29 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 302f3549-6a63-54d0-9729-d1b8ae33d17f with scrape type 2
2026-03-29 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 302f3549-6a63-54d0-9729-d1b8ae33d17f with scrape type 2
2026-03-29 12:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 302f3549-6a63-54d0-9729-d1b8ae33d17f, identifier: CN90357
2026-03-29 12:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 302f3549-6a63-54d0-9729-d1b8ae33d17f with identifier: CN90357
2026-03-29 12:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 302f3549-6a63-54d0-9729-d1b8ae33d17f with identifier: CN90357
2026-03-29 12:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 302f3549-6a63-54d0-9729-d1b8ae33d17f with identifier: CN90357 to the API
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:29:33Z',
 'fuel_type': 'petrol',
 'id': '302f3549-6a63-54d0-9729-d1b8ae33d17f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN90357',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Starlet',
 'odometer': 182773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-01-23',
 'seller_name': None,
 'title': 'Toyota Starlet 1.3 XLi',
 'transmission': 'manual',
 'trim': 'XLi',
 'year': 1992}
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-29 12:10:26 [auto1.nl] INFO: Saving data for CN90357: {'auction_closing_time': 1774884573.0, 'created_time': 1774552338.608898, 'last_price_update_time': 1774786226.382778}
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CN90357') HTTP/1.1" 204 0
2026-03-29 12:10:26 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-29 12:10:26 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-29 12:10:26 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-29 12:10:26 [auto1.nl] INFO: Scrape type for CN90357: 0
2026-03-29 12:10:26 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-29 12:10:26 [auto1.nl] INFO: Scrape type for JG60699: 2
2026-03-29 12:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699
2026-03-29 12:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f5f36b3-3093-5656-923f-dd351ff4ac28 with scrape type 2
2026-03-29 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f5f36b3-3093-5656-923f-dd351ff4ac28 with scrape type 2
2026-03-29 12:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f5f36b3-3093-5656-923f-dd351ff4ac28, identifier: JG60699
2026-03-29 12:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:26 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-29 12:10:26 [auto1.nl] INFO: Scrape type for JG60699: 2
2026-03-29 12:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f5f36b3-3093-5656-923f-dd351ff4ac28 with scrape type 2
2026-03-29 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f5f36b3-3093-5656-923f-dd351ff4ac28 with scrape type 2
2026-03-29 12:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f5f36b3-3093-5656-923f-dd351ff4ac28, identifier: JG60699
2026-03-29 12:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699
2026-03-29 12:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699
2026-03-29 12:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699 to the API
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:11:56Z',
 'fuel_type': 'petrol',
 'id': '3f5f36b3-3093-5656-923f-dd351ff4ac28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG60699',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'Premacy',
 'odometer': 189288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-20',
 'seller_name': None,
 'title': 'Mazda Premacy 2.0 Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2003}
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-29 12:10:27 [auto1.nl] INFO: Saving data for JG60699: {'auction_closing_time': 1774883516.0, 'created_time': 1773861327.754043, 'last_price_update_time': 1774786227.049453}
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG60699') HTTP/1.1" 204 0
2026-03-29 12:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699
2026-03-29 12:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699
2026-03-29 12:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f5f36b3-3093-5656-923f-dd351ff4ac28 with identifier: JG60699 to the API
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:11:56Z',
 'fuel_type': 'petrol',
 'id': '3f5f36b3-3093-5656-923f-dd351ff4ac28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG60699',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'Premacy',
 'odometer': 189288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-20',
 'seller_name': None,
 'title': 'Mazda Premacy 2.0 Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2003}
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-29 12:10:27 [auto1.nl] INFO: Saving data for JG60699: {'auction_closing_time': 1774883516.0, 'created_time': 1773861327.754043, 'last_price_update_time': 1774786227.314709}
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG60699') HTTP/1.1" 204 0
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-29 12:10:27 [auto1.nl] INFO: Scrape type for ZJ02157: 1
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-29 12:10:27 [auto1.nl] INFO: Scrape type for GX78126: 2
2026-03-29 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126
2026-03-29 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9087dd2-d140-5332-becb-315d2d870249 with scrape type 2
2026-03-29 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9087dd2-d140-5332-becb-315d2d870249 with scrape type 2
2026-03-29 12:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b9087dd2-d140-5332-becb-315d2d870249, identifier: GX78126
2026-03-29 12:10:27 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-29 12:10:27 [auto1.nl] INFO: Scrape type for GX78126: 2
2026-03-29 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9087dd2-d140-5332-becb-315d2d870249 with scrape type 2
2026-03-29 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9087dd2-d140-5332-becb-315d2d870249 with scrape type 2
2026-03-29 12:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b9087dd2-d140-5332-becb-315d2d870249, identifier: GX78126
2026-03-29 12:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126
2026-03-29 12:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126
2026-03-29 12:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126 to the API
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:04:27Z',
 'fuel_type': 'petrol',
 'id': 'b9087dd2-d140-5332-becb-315d2d870249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX78126',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 255204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-29 12:10:27 [auto1.nl] INFO: Saving data for GX78126: {'auction_closing_time': 1774883067.0, 'created_time': 1773688566.13225, 'last_price_update_time': 1774786227.887392}
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GX78126') HTTP/1.1" 204 0
2026-03-29 12:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126
2026-03-29 12:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126
2026-03-29 12:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b9087dd2-d140-5332-becb-315d2d870249 with identifier: GX78126 to the API
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:04:27Z',
 'fuel_type': 'petrol',
 'id': 'b9087dd2-d140-5332-becb-315d2d870249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX78126',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 255204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-29 12:10:28 [auto1.nl] INFO: Saving data for GX78126: {'auction_closing_time': 1774883067.0, 'created_time': 1773688566.13225, 'last_price_update_time': 1774786228.246764}
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GX78126') HTTP/1.1" 204 0
2026-03-29 12:10:28 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-29 12:10:28 [auto1.nl] INFO: Scrape type for ME06294: 2
2026-03-29 12:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294
2026-03-29 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2147ca-2613-525f-823c-999e282f8356 with scrape type 2
2026-03-29 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df2147ca-2613-525f-823c-999e282f8356 with scrape type 2
2026-03-29 12:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: df2147ca-2613-525f-823c-999e282f8356, identifier: ME06294
2026-03-29 12:10:28 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-29 12:10:28 [auto1.nl] INFO: Scrape type for ME06294: 2
2026-03-29 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2147ca-2613-525f-823c-999e282f8356 with scrape type 2
2026-03-29 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df2147ca-2613-525f-823c-999e282f8356 with scrape type 2
2026-03-29 12:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: df2147ca-2613-525f-823c-999e282f8356, identifier: ME06294
2026-03-29 12:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 12:10:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294
2026-03-29 12:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294 to the API
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:44:14Z',
 'fuel_type': 'diesel',
 'id': 'df2147ca-2613-525f-823c-999e282f8356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME06294',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 135098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-06-22',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 Diesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2000}
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-29 12:10:28 [auto1.nl] INFO: Saving data for ME06294: {'auction_closing_time': 1774885454.0, 'created_time': 1774552298.739491, 'last_price_update_time': 1774786228.942633}
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME06294') HTTP/1.1" 204 0
2026-03-29 12:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294
2026-03-29 12:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294
2026-03-29 12:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: df2147ca-2613-525f-823c-999e282f8356 with identifier: ME06294 to the API
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:44:14Z',
 'fuel_type': 'diesel',
 'id': 'df2147ca-2613-525f-823c-999e282f8356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME06294',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 135098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-06-22',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 Diesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2000}
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-29 12:10:29 [auto1.nl] INFO: Saving data for ME06294: {'auction_closing_time': 1774885454.0, 'created_time': 1774552298.739491, 'last_price_update_time': 1774786229.202949}
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME06294') HTTP/1.1" 204 0
2026-03-29 12:10:29 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN80164%27 HTTP/1.1" 200 None
2026-03-29 12:10:29 [auto1.nl] INFO: Scrape type for NN80164: 1
2026-03-29 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW98362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:29 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-29 12:10:29 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-29 12:10:29 [auto1.nl] INFO: Scrape type for AW61305: 2
2026-03-29 12:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-29 12:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30e26517-6d5d-5863-823e-b00c4ac6e534 with scrape type 2
2026-03-29 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30e26517-6d5d-5863-823e-b00c4ac6e534 with scrape type 2
2026-03-29 12:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30e26517-6d5d-5863-823e-b00c4ac6e534, identifier: AW61305
2026-03-29 12:10:29 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-29 12:10:29 [auto1.nl] INFO: Scrape type for AW61305: 2
2026-03-29 12:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30e26517-6d5d-5863-823e-b00c4ac6e534 with scrape type 2
2026-03-29 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30e26517-6d5d-5863-823e-b00c4ac6e534 with scrape type 2
2026-03-29 12:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30e26517-6d5d-5863-823e-b00c4ac6e534, identifier: AW61305
2026-03-29 12:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-29 12:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-29 12:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305 to the API
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:17:43Z',
 'fuel_type': 'petrol',
 'id': '30e26517-6d5d-5863-823e-b00c4ac6e534',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW61305',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 159970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-15',
 'seller_name': None,
 'title': 'Renault Scenic 2.0 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2006}
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-29 12:10:29 [auto1.nl] INFO: Saving data for AW61305: {'auction_closing_time': 1774883863.0, 'created_time': 1774638709.611317, 'last_price_update_time': 1774786229.832171}
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW61305') HTTP/1.1" 204 0
2026-03-29 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-29 12:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305
2026-03-29 12:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30e26517-6d5d-5863-823e-b00c4ac6e534 with identifier: AW61305 to the API
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:17:43Z',
 'fuel_type': 'petrol',
 'id': '30e26517-6d5d-5863-823e-b00c4ac6e534',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW61305',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 159970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-15',
 'seller_name': None,
 'title': 'Renault Scenic 2.0 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2006}
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-29 12:10:30 [auto1.nl] INFO: Saving data for AW61305: {'auction_closing_time': 1774883863.0, 'created_time': 1774638709.611317, 'last_price_update_time': 1774786230.123743}
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW61305') HTTP/1.1" 204 0
2026-03-29 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF19474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:30 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:30 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX02211%27 HTTP/1.1" 200 None
2026-03-29 12:10:30 [auto1.nl] INFO: Scrape type for LX02211: 1
2026-03-29 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:30 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-29 12:10:30 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY24262%27 HTTP/1.1" 200 None
2026-03-29 12:10:30 [auto1.nl] INFO: Scrape type for PY24262: 2
2026-03-29 12:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7551f8a7-14af-53b8-83e5-3d9993efd856 with identifier: PY24262
2026-03-29 12:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7551f8a7-14af-53b8-83e5-3d9993efd856 with scrape type 2
2026-03-29 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7551f8a7-14af-53b8-83e5-3d9993efd856 with scrape type 2
2026-03-29 12:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7551f8a7-14af-53b8-83e5-3d9993efd856, identifier: PY24262
2026-03-29 12:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7551f8a7-14af-53b8-83e5-3d9993efd856 with identifier: PY24262
2026-03-29 12:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7551f8a7-14af-53b8-83e5-3d9993efd856 with identifier: PY24262
2026-03-29 12:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7551f8a7-14af-53b8-83e5-3d9993efd856 with identifier: PY24262 to the API
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:45:44Z',
 'fuel_type': 'petrol',
 'id': '7551f8a7-14af-53b8-83e5-3d9993efd856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY24262',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 211324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-23',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY24262%27 HTTP/1.1" 200 None
2026-03-29 12:10:30 [auto1.nl] INFO: Saving data for PY24262: {'auction_closing_time': 1774885544.0, 'created_time': 1773232129.389805, 'last_price_update_time': 1774786230.6768}
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY24262') HTTP/1.1" 204 0
2026-03-29 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:30 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-29 12:10:30 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB25892%27 HTTP/1.1" 200 None
2026-03-29 12:10:30 [auto1.nl] INFO: Scrape type for YB25892: 1
2026-03-29 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:30 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW76665%27 HTTP/1.1" 200 None
2026-03-29 12:10:30 [auto1.nl] INFO: Scrape type for DW76665: 2
2026-03-29 12:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with identifier: DW76665
2026-03-29 12:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with scrape type 2
2026-03-29 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with scrape type 2
2026-03-29 12:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14, identifier: DW76665
2026-03-29 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ02157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with identifier: DW76665
2026-03-29 12:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with identifier: DW76665
2026-03-29 12:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6bccfc5-c98b-5a31-b331-2ecdc3b1ae14 with identifier: DW76665 to the API
2026-03-29 12:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:55:47Z',
 'fuel_type': 'petrol',
 'id': 'd6bccfc5-c98b-5a31-b331-2ecdc3b1ae14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW76665',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 257867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-03',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW76665%27 HTTP/1.1" 200 None
2026-03-29 12:10:31 [auto1.nl] INFO: Saving data for DW76665: {'auction_closing_time': 1774886147.0, 'created_time': 1773342949.803383, 'last_price_update_time': 1774786231.299473}
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW76665') HTTP/1.1" 204 0
2026-03-29 12:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:31 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-29 12:10:31 [auto1.nl] INFO: Scrape type for JW20864: 2
2026-03-29 12:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-29 12:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with scrape type 2
2026-03-29 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with scrape type 2
2026-03-29 12:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4, identifier: JW20864
2026-03-29 12:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-29 12:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-29 12:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864 to the API
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:48:34Z',
 'fuel_type': 'petrol',
 'id': 'e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW20864',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 178267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-29 12:10:31 [auto1.nl] INFO: Saving data for JW20864: {'auction_closing_time': 1774885714.0, 'created_time': 1774552284.400372, 'last_price_update_time': 1774786231.797384}
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW20864') HTTP/1.1" 204 0
2026-03-29 12:10:31 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-29 12:10:31 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-29 12:10:31 [auto1.nl] INFO: Scrape type for JZ35389: 2
2026-03-29 12:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-29 12:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with scrape type 2
2026-03-29 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with scrape type 2
2026-03-29 12:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9, identifier: JZ35389
2026-03-29 12:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-29 12:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389
2026-03-29 12:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 93cd7e3d-d7ce-5e33-ba36-2162454e8cb9 with identifier: JZ35389 to the API
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:17Z',
 'fuel_type': 'petrol',
 'id': '93cd7e3d-d7ce-5e33-ba36-2162454e8cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ35389',
 'listing': 'auction',
 'make': 'Saab',
 'model': '9-3',
 'odometer': 273610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-08-28',
 'seller_name': None,
 'title': 'Saab 9-3 2.0 T',
 'transmission': 'manual',
 'trim': 'T',
 'year': 2002}
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-29 12:10:32 [auto1.nl] INFO: Saving data for JZ35389: {'auction_closing_time': 1774885157.0, 'created_time': 1774638688.620834, 'last_price_update_time': 1774786232.216611}
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JZ35389') HTTP/1.1" 204 0
2026-03-29 12:10:32 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK38734%27 HTTP/1.1" 200 None
2026-03-29 12:10:32 [auto1.nl] INFO: Scrape type for RK38734: 1
2026-03-29 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN80164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:32 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG10005%27 HTTP/1.1" 200 None
2026-03-29 12:10:32 [auto1.nl] INFO: Scrape type for KG10005: 2
2026-03-29 12:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with identifier: KG10005
2026-03-29 12:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with scrape type 2
2026-03-29 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with scrape type 2
2026-03-29 12:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b, identifier: KG10005
2026-03-29 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with identifier: KG10005
2026-03-29 12:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with identifier: KG10005
2026-03-29 12:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ecd4a5ef-1b87-567e-9bf2-ad1e0115051b with identifier: KG10005 to the API
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:14:15Z',
 'fuel_type': 'petrol',
 'id': 'ecd4a5ef-1b87-567e-9bf2-ad1e0115051b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG10005',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 291669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-07',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG10005%27 HTTP/1.1" 200 None
2026-03-29 12:10:32 [auto1.nl] INFO: Saving data for KG10005: {'auction_closing_time': 1774883655.0, 'created_time': 1774552354.884837, 'last_price_update_time': 1774786232.675097}
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KG10005') HTTP/1.1" 204 0
2026-03-29 12:10:32 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-29 12:10:32 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA59748%27 HTTP/1.1" 200 None
2026-03-29 12:10:32 [auto1.nl] INFO: Scrape type for NA59748: 1
2026-03-29 12:10:32 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-29 12:10:32 [auto1.nl] INFO: Scrape type for NT73578: 2
2026-03-29 12:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-29 12:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with scrape type 2
2026-03-29 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with scrape type 2
2026-03-29 12:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 055966f4-c3ce-500a-bade-b5abdc9cd5d3, identifier: NT73578
2026-03-29 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW98362> (referer: https://www.auto1.com/v1/car-details-view/BW98362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-29 12:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578
2026-03-29 12:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 055966f4-c3ce-500a-bade-b5abdc9cd5d3 with identifier: NT73578 to the API
2026-03-29 12:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:01Z',
 'fuel_type': 'diesel',
 'id': '055966f4-c3ce-500a-bade-b5abdc9cd5d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT73578',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-06',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [auto1.nl] INFO: Saving data for NT73578: {'auction_closing_time': 1774884841.0, 'created_time': 1773923868.168898, 'last_price_update_time': 1774786233.153119}
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT73578') HTTP/1.1" 204 0
2026-03-29 12:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:33 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW17095%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [auto1.nl] INFO: Scrape type for XW17095: 1
2026-03-29 12:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:33 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-29 12:10:33 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MG34346%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [auto1.nl] INFO: Scrape type for MG34346: 1
2026-03-29 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF19474> (referer: https://www.auto1.com/v1/car-details-view/YF19474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:33 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35a7dbd-c173-5002-92b1-b0660f881a04 with identifier: BW98362
2026-03-29 12:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35a7dbd-c173-5002-92b1-b0660f881a04 with scrape type 1
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b35a7dbd-c173-5002-92b1-b0660f881a04
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_cd12c6f3a468d5a4c2b1dfe3d094af78.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_cd12c6f3a468d5a4c2b1dfe3d094af78.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_dfb9bb2b46527e010c1e7e5c654c1a53.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_dfb9bb2b46527e010c1e7e5c654c1a53.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_1820a55e89d1e23da141f80d94d38f7d.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_1820a55e89d1e23da141f80d94d38f7d.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_76a685063439cdb086d1c0b5e5340564.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_76a685063439cdb086d1c0b5e5340564.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_0d9822852ec6374e9a59d3bf05e4b664.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_0d9822852ec6374e9a59d3bf05e4b664.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_cab0b3792866c99e1a65381cbfc82ddd.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_cab0b3792866c99e1a65381cbfc82ddd.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_e36f6f0eccce33f00ef75ef062f7e40b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_e36f6f0eccce33f00ef75ef062f7e40b.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_d09b60e9fd89a6cc4e4a805e974f6956.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_d09b60e9fd89a6cc4e4a805e974f6956.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_7c11e5f458adf58a6e57c45f78c03d12.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_7c11e5f458adf58a6e57c45f78c03d12.jpg already downloaded
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fbe%252F4ebe1fe164a8a5556b3174507d8a5da3%252Fpa%252FBW98362_50acfd4df757fc930555dfbc591de99e.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_50acfd4df757fc930555dfbc591de99e.jpg already downloaded
2026-03-29 12:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b35a7dbd-c173-5002-92b1-b0660f881a04, identifier: BW98362
2026-03-29 12:10:33 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-29 12:10:33 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-29 12:10:33 [auto1.nl] INFO: Scrape type for ZE21436: 2
2026-03-29 12:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-29 12:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with scrape type 2
2026-03-29 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with scrape type 2
2026-03-29 12:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b, identifier: ZE21436
2026-03-29 12:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b35a7dbd-c173-5002-92b1-b0660f881a04 with identifier: BW98362
2026-03-29 12:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b35a7dbd-c173-5002-92b1-b0660f881a04 with identifier: BW98362
2026-03-29 12:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b35a7dbd-c173-5002-92b1-b0660f881a04 with identifier: BW98362 to the API
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW98362>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:20:44Z',
 'fuel_type': 'petrol',
 'id': 'b35a7dbd-c173-5002-92b1-b0660f881a04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GTN66Z',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW98362',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 158700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_cd12c6f3a468d5a4c2b1dfe3d094af78.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_dfb9bb2b46527e010c1e7e5c654c1a53.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_1820a55e89d1e23da141f80d94d38f7d.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_76a685063439cdb086d1c0b5e5340564.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_0d9822852ec6374e9a59d3bf05e4b664.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_cab0b3792866c99e1a65381cbfc82ddd.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_e36f6f0eccce33f00ef75ef062f7e40b.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_d09b60e9fd89a6cc4e4a805e974f6956.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_7c11e5f458adf58a6e57c45f78c03d12.jpg',
                'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_50acfd4df757fc930555dfbc591de99e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_cd12c6f3a468d5a4c2b1dfe3d094af78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_dfb9bb2b46527e010c1e7e5c654c1a53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_1820a55e89d1e23da141f80d94d38f7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_76a685063439cdb086d1c0b5e5340564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_0d9822852ec6374e9a59d3bf05e4b664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_cab0b3792866c99e1a65381cbfc82ddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_e36f6f0eccce33f00ef75ef062f7e40b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_d09b60e9fd89a6cc4e4a805e974f6956.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_7c11e5f458adf58a6e57c45f78c03d12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b35a7dbd-c173-5002-92b1-b0660f881a04/b35a7dbd-c173-5002-92b1-b0660f881a04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/be/4ebe1fe164a8a5556b3174507d8a5da3/pa/BW98362_50acfd4df757fc930555dfbc591de99e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-29',
 'seats_number': 1,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-29 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW98362%27 HTTP/1.1" 200 None
2026-03-29 12:10:34 [auto1.nl] INFO: Saving data for BW98362: {'created_time': 1774786234.004936, 'last_price_update_time': 1774786234.00495, 'auction_closing_time': 1774884044.0}
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BW98362') HTTP/1.1" 204 0
2026-03-29 12:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-29 12:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436
2026-03-29 12:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ce19f29-2e87-5963-808e-a7e3eb7d2d2b with identifier: ZE21436 to the API
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:58:03Z',
 'fuel_type': 'diesel',
 'id': '4ce19f29-2e87-5963-808e-a7e3eb7d2d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE21436',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 178348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-11-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 Diesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 1997}
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-29 12:10:34 [auto1.nl] INFO: Saving data for ZE21436: {'auction_closing_time': 1774886283.0, 'created_time': 1774465847.593938, 'last_price_update_time': 1774786234.406293}
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE21436') HTTP/1.1" 204 0
2026-03-29 12:10:34 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-29 12:10:34 [auto1.nl] INFO: Scrape type for SS31744: 2
2026-03-29 12:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-29 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with scrape type 2
2026-03-29 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with scrape type 2
2026-03-29 12:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c92c6ce7-fe04-5511-b5e2-06e6d61ef918, identifier: SS31744
2026-03-29 12:10:34 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-29 12:10:34 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-29 12:10:34 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-29 12:10:34 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-29 12:10:34 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY98170%27 HTTP/1.1" 200 None
2026-03-29 12:10:34 [auto1.nl] INFO: Scrape type for NY98170: 2
2026-03-29 12:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 182ed0a8-33af-53cc-b8df-3b8d581e046d with identifier: NY98170
2026-03-29 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 182ed0a8-33af-53cc-b8df-3b8d581e046d with scrape type 2
2026-03-29 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 182ed0a8-33af-53cc-b8df-3b8d581e046d with scrape type 2
2026-03-29 12:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 182ed0a8-33af-53cc-b8df-3b8d581e046d, identifier: NY98170
2026-03-29 12:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-29 12:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744
2026-03-29 12:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c92c6ce7-fe04-5511-b5e2-06e6d61ef918 with identifier: SS31744 to the API
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:31Z',
 'fuel_type': 'petrol',
 'id': 'c92c6ce7-fe04-5511-b5e2-06e6d61ef918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS31744',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 114328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-29 12:10:34 [auto1.nl] INFO: Saving data for SS31744: {'auction_closing_time': 1774885711.0, 'created_time': 1773301901.096264, 'last_price_update_time': 1774786234.952043}
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SS31744') HTTP/1.1" 204 0
2026-03-29 12:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK38734/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX02211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e03a149d-6c16-5723-8c12-d8cef6132cfa with identifier: YF19474
2026-03-29 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e03a149d-6c16-5723-8c12-d8cef6132cfa with scrape type 1
2026-03-29 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e03a149d-6c16-5723-8c12-d8cef6132cfa
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_6c16ff03fe29850d1e8b10f63e81fd71.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_6c16ff03fe29850d1e8b10f63e81fd71.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_80ab556b5fa305ac0ed937c6216ee819.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_80ab556b5fa305ac0ed937c6216ee819.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_5e585cc7be15c1a47a75f08ea7f33811.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_5e585cc7be15c1a47a75f08ea7f33811.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_d96386b8f52d737d03802f6e45a3b607.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_d96386b8f52d737d03802f6e45a3b607.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_cbc6b2f01b636ee94b5d67fca9aa071a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_cbc6b2f01b636ee94b5d67fca9aa071a.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_e24080a12a0c4edeb23c5b87b20a0240.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_e24080a12a0c4edeb23c5b87b20a0240.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_a599d54c0cf84c2b458b2fc30ad9ea22.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_a599d54c0cf84c2b458b2fc30ad9ea22.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_aadaa1f6aada1c4982950fbee84cc21b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_aadaa1f6aada1c4982950fbee84cc21b.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_3a3badd0c081ceaeee523d8fcbb5b062.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_3a3badd0c081ceaeee523d8fcbb5b062.jpg already downloaded
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Fad%252F8dadbb7bdba0b8df0797c5c663419a2b%252Fpa%252FYF19474_d3aaa9d231315786d46b32d3aac5ce54.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_d3aaa9d231315786d46b32d3aac5ce54.jpg already downloaded
2026-03-29 12:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e03a149d-6c16-5723-8c12-d8cef6132cfa, identifier: YF19474
2026-03-29 12:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 182ed0a8-33af-53cc-b8df-3b8d581e046d with identifier: NY98170
2026-03-29 12:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 182ed0a8-33af-53cc-b8df-3b8d581e046d with identifier: NY98170
2026-03-29 12:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 182ed0a8-33af-53cc-b8df-3b8d581e046d with identifier: NY98170 to the API
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:15Z',
 'fuel_type': 'petrol',
 'id': '182ed0a8-33af-53cc-b8df-3b8d581e046d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY98170',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 100734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-15',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2020}
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY98170%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [auto1.nl] INFO: Saving data for NY98170: {'auction_closing_time': 1774885395.0, 'created_time': 1773429238.035221, 'last_price_update_time': 1774786235.799342}
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY98170') HTTP/1.1" 204 0
2026-03-29 12:10:35 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-29 12:10:35 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-29 12:10:35 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-29 12:10:35 [auto1.nl] INFO: Scrape type for GY89787: 2
2026-03-29 12:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-29 12:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01d01af-7b71-5e80-9de1-9995851d01ef with scrape type 2
2026-03-29 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b01d01af-7b71-5e80-9de1-9995851d01ef with scrape type 2
2026-03-29 12:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b01d01af-7b71-5e80-9de1-9995851d01ef, identifier: GY89787
2026-03-29 12:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB25892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e03a149d-6c16-5723-8c12-d8cef6132cfa with identifier: YF19474
2026-03-29 12:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e03a149d-6c16-5723-8c12-d8cef6132cfa with identifier: YF19474
2026-03-29 12:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e03a149d-6c16-5723-8c12-d8cef6132cfa with identifier: YF19474 to the API
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YF19474>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:26:44Z',
 'fuel_type': 'petrol',
 'id': 'e03a149d-6c16-5723-8c12-d8cef6132cfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RP340X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF19474',
 'listing': 'auction',
 'location': 'NL, Amstelveen',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 111930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_6c16ff03fe29850d1e8b10f63e81fd71.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_80ab556b5fa305ac0ed937c6216ee819.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_5e585cc7be15c1a47a75f08ea7f33811.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_d96386b8f52d737d03802f6e45a3b607.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_cbc6b2f01b636ee94b5d67fca9aa071a.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_e24080a12a0c4edeb23c5b87b20a0240.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_a599d54c0cf84c2b458b2fc30ad9ea22.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_aadaa1f6aada1c4982950fbee84cc21b.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_3a3badd0c081ceaeee523d8fcbb5b062.jpg',
                'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_d3aaa9d231315786d46b32d3aac5ce54.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_6c16ff03fe29850d1e8b10f63e81fd71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_80ab556b5fa305ac0ed937c6216ee819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_5e585cc7be15c1a47a75f08ea7f33811.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_d96386b8f52d737d03802f6e45a3b607.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_cbc6b2f01b636ee94b5d67fca9aa071a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_e24080a12a0c4edeb23c5b87b20a0240.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_a599d54c0cf84c2b458b2fc30ad9ea22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_aadaa1f6aada1c4982950fbee84cc21b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_3a3badd0c081ceaeee523d8fcbb5b062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e03a149d-6c16-5723-8c12-d8cef6132cfa/e03a149d-6c16-5723-8c12-d8cef6132cfa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/ad/8dadbb7bdba0b8df0797c5c663419a2b/pa/YF19474_d3aaa9d231315786d46b32d3aac5ce54.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2018}
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF19474%27 HTTP/1.1" 200 None
2026-03-29 12:10:36 [auto1.nl] INFO: Saving data for YF19474: {'created_time': 1774786236.234471, 'last_price_update_time': 1774786236.23448, 'auction_closing_time': 1774884404.0}
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YF19474') HTTP/1.1" 204 0
2026-03-29 12:10:36 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV60983%27 HTTP/1.1" 200 None
2026-03-29 12:10:36 [auto1.nl] INFO: Scrape type for YV60983: 2
2026-03-29 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4b9833-8220-5c32-9a6e-47ae93b9b721 with identifier: YV60983
2026-03-29 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4b9833-8220-5c32-9a6e-47ae93b9b721 with scrape type 2
2026-03-29 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4b9833-8220-5c32-9a6e-47ae93b9b721 with scrape type 2
2026-03-29 12:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ce4b9833-8220-5c32-9a6e-47ae93b9b721, identifier: YV60983
2026-03-29 12:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-29 12:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-29 12:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787 to the API
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:34:18Z',
 'fuel_type': 'petrol',
 'id': 'b01d01af-7b71-5e80-9de1-9995851d01ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY89787',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 252042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-14',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T4 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2011}
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-29 12:10:36 [auto1.nl] INFO: Saving data for GY89787: {'auction_closing_time': 1774884858.0, 'created_time': 1773133072.515458, 'last_price_update_time': 1774786236.668461}
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY89787') HTTP/1.1" 204 0
2026-03-29 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ02157> (referer: https://www.auto1.com/v1/car-details-view/ZJ02157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ce4b9833-8220-5c32-9a6e-47ae93b9b721 with identifier: YV60983
2026-03-29 12:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ce4b9833-8220-5c32-9a6e-47ae93b9b721 with identifier: YV60983
2026-03-29 12:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ce4b9833-8220-5c32-9a6e-47ae93b9b721 with identifier: YV60983 to the API
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:40Z',
 'fuel_type': 'petrol',
 'id': 'ce4b9833-8220-5c32-9a6e-47ae93b9b721',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV60983',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 326293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-12',
 'seller_name': None,
 'title': 'Audi A6 2.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV60983%27 HTTP/1.1" 200 None
2026-03-29 12:10:36 [auto1.nl] INFO: Saving data for YV60983: {'auction_closing_time': 1774885900.0, 'created_time': 1773342991.752715, 'last_price_update_time': 1774786236.982556}
2026-03-29 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YV60983') HTTP/1.1" 204 0
2026-03-29 12:10:37 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-29 12:10:37 [auto1.nl] INFO: Scrape type for VL52985: 2
2026-03-29 12:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-29 12:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b50388c-81a6-5005-86ae-e904bf073f82 with scrape type 2
2026-03-29 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b50388c-81a6-5005-86ae-e904bf073f82 with scrape type 2
2026-03-29 12:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b50388c-81a6-5005-86ae-e904bf073f82, identifier: VL52985
2026-03-29 12:10:37 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-29 12:10:37 [auto1.nl] INFO: Scrape type for GK27630: 2
2026-03-29 12:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-29 12:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deac8add-ab2e-5633-9caf-542ff677dfb3 with scrape type 2
2026-03-29 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deac8add-ab2e-5633-9caf-542ff677dfb3 with scrape type 2
2026-03-29 12:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: deac8add-ab2e-5633-9caf-542ff677dfb3, identifier: GK27630
2026-03-29 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-29 12:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985
2026-03-29 12:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b50388c-81a6-5005-86ae-e904bf073f82 with identifier: VL52985 to the API
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:40:09Z',
 'fuel_type': 'petrol',
 'id': '2b50388c-81a6-5005-86ae-e904bf073f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL52985',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 182503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-05',
 'seller_name': None,
 'title': 'Kia Venga 1.6 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2012}
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-29 12:10:37 [auto1.nl] INFO: Saving data for VL52985: {'auction_closing_time': 1774885209.0, 'created_time': 1773342980.661633, 'last_price_update_time': 1774786237.505357}
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL52985') HTTP/1.1" 204 0
2026-03-29 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-29 12:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-29 12:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630 to the API
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:05:34Z',
 'fuel_type': 'petrol',
 'id': 'deac8add-ab2e-5633-9caf-542ff677dfb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK27630',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 25900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2022}
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-29 12:10:37 [auto1.nl] INFO: Saving data for GK27630: {'auction_closing_time': 1774883134.0, 'created_time': 1773688530.587234, 'last_price_update_time': 1774786237.956059}
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GK27630') HTTP/1.1" 204 0
2026-03-29 12:10:37 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA77037%27 HTTP/1.1" 200 None
2026-03-29 12:10:37 [auto1.nl] INFO: Scrape type for CA77037: 2
2026-03-29 12:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fded7c72-7132-5eb6-99ad-35696cf9b672 with identifier: CA77037
2026-03-29 12:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fded7c72-7132-5eb6-99ad-35696cf9b672 with scrape type 2
2026-03-29 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fded7c72-7132-5eb6-99ad-35696cf9b672 with scrape type 2
2026-03-29 12:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fded7c72-7132-5eb6-99ad-35696cf9b672, identifier: CA77037
2026-03-29 12:10:38 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-29 12:10:38 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC52581%27 HTTP/1.1" 200 None
2026-03-29 12:10:38 [auto1.nl] INFO: Scrape type for TC52581: 2
2026-03-29 12:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a1c54d5-8a20-5069-b418-a5e010fef81a with identifier: TC52581
2026-03-29 12:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a1c54d5-8a20-5069-b418-a5e010fef81a with scrape type 2
2026-03-29 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a1c54d5-8a20-5069-b418-a5e010fef81a with scrape type 2
2026-03-29 12:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3a1c54d5-8a20-5069-b418-a5e010fef81a, identifier: TC52581
2026-03-29 12:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fded7c72-7132-5eb6-99ad-35696cf9b672 with identifier: CA77037
2026-03-29 12:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fded7c72-7132-5eb6-99ad-35696cf9b672 with identifier: CA77037
2026-03-29 12:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fded7c72-7132-5eb6-99ad-35696cf9b672 with identifier: CA77037 to the API
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:52:03Z',
 'fuel_type': 'petrol',
 'id': 'fded7c72-7132-5eb6-99ad-35696cf9b672',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA77037',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 199038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-17',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA77037%27 HTTP/1.1" 200 None
2026-03-29 12:10:38 [auto1.nl] INFO: Saving data for CA77037: {'auction_closing_time': 1774885923.0, 'created_time': 1773837157.292507, 'last_price_update_time': 1774786238.488344}
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA77037') HTTP/1.1" 204 0
2026-03-29 12:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3a1c54d5-8a20-5069-b418-a5e010fef81a with identifier: TC52581
2026-03-29 12:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3a1c54d5-8a20-5069-b418-a5e010fef81a with identifier: TC52581
2026-03-29 12:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3a1c54d5-8a20-5069-b418-a5e010fef81a with identifier: TC52581 to the API
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:54Z',
 'fuel_type': 'diesel',
 'id': '3a1c54d5-8a20-5069-b418-a5e010fef81a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC52581',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 290656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-09',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.3 M-Jet Multijet Cult',
 'transmission': 'manual',
 'trim': 'Multijet Cult',
 'year': 2011}
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC52581%27 HTTP/1.1" 200 None
2026-03-29 12:10:38 [auto1.nl] INFO: Saving data for TC52581: {'auction_closing_time': 1774885254.0, 'created_time': 1774552289.577826, 'last_price_update_time': 1774786238.820936}
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC52581') HTTP/1.1" 204 0
2026-03-29 12:10:38 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC51093%27 HTTP/1.1" 200 None
2026-03-29 12:10:38 [auto1.nl] INFO: Scrape type for MC51093: 2
2026-03-29 12:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with identifier: MC51093
2026-03-29 12:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with scrape type 2
2026-03-29 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with scrape type 2
2026-03-29 12:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa, identifier: MC51093
2026-03-29 12:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-29 12:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 402093a2-ccab-5cdf-9b16-953d5eb0edbc with scrape type 1
2026-03-29 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 402093a2-ccab-5cdf-9b16-953d5eb0edbc
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_482e3342609b68ce9b60719e50b6729c.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_482e3342609b68ce9b60719e50b6729c.jpg already downloaded
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_f2e1fee61def78719682d1f3927fb121.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_f2e1fee61def78719682d1f3927fb121.jpg already downloaded
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_664dba5a79b4bb28115ceff72ad926e8.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_664dba5a79b4bb28115ceff72ad926e8.jpg already downloaded
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_b8355a88b7c93b8863b3ce731ebf9420.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_b8355a88b7c93b8863b3ce731ebf9420.jpg already downloaded
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_16caafcd41c77d79368b4985c51efb1a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_16caafcd41c77d79368b4985c51efb1a.jpg already downloaded
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_c4b296dd6a012313b453e5ce76dd966b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_c4b296dd6a012313b453e5ce76dd966b.jpg already downloaded
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_c641b9c4ef0fc18fe1aa335235d594af.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_c641b9c4ef0fc18fe1aa335235d594af.jpg already downloaded
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_13deaddc2daf5e68ecf1423e0344fd7e.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_13deaddc2daf5e68ecf1423e0344fd7e.jpg already downloaded
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_0a229e9d59c49dccebab9df2a288a93a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_0a229e9d59c49dccebab9df2a288a93a.jpg already downloaded
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F8b%252F0e8b906c64e84c39c3e636d110e8ba7c%252Fpa%252FZJ02157_4de1dad03b8ef08c75986af05aafabc8.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_4de1dad03b8ef08c75986af05aafabc8.jpg already downloaded
2026-03-29 12:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 402093a2-ccab-5cdf-9b16-953d5eb0edbc, identifier: ZJ02157
2026-03-29 12:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:39 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC17693%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [auto1.nl] INFO: Scrape type for GC17693: 1
2026-03-29 12:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with identifier: MC51093
2026-03-29 12:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with identifier: MC51093
2026-03-29 12:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f291cd5-1ed2-5803-af3f-db5a7ad55afa with identifier: MC51093 to the API
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:18Z',
 'fuel_type': 'petrol',
 'id': '3f291cd5-1ed2-5803-af3f-db5a7ad55afa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC51093',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 63789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC51093%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [auto1.nl] INFO: Saving data for MC51093: {'auction_closing_time': 1774883358.0, 'created_time': 1773231950.278401, 'last_price_update_time': 1774786239.637241}
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MC51093') HTTP/1.1" 204 0
2026-03-29 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW17095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN80164> (referer: https://www.auto1.com/v1/car-details-view/NN80164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-29 12:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-29 12:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157 to the API
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZJ02157>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:19Z',
 'fuel_type': 'petrol',
 'id': '402093a2-ccab-5cdf-9b16-953d5eb0edbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GXZ70Z',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ02157',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 134313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_482e3342609b68ce9b60719e50b6729c.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_f2e1fee61def78719682d1f3927fb121.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_664dba5a79b4bb28115ceff72ad926e8.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_b8355a88b7c93b8863b3ce731ebf9420.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_16caafcd41c77d79368b4985c51efb1a.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_c4b296dd6a012313b453e5ce76dd966b.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_c641b9c4ef0fc18fe1aa335235d594af.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_13deaddc2daf5e68ecf1423e0344fd7e.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_0a229e9d59c49dccebab9df2a288a93a.jpg',
                'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_4de1dad03b8ef08c75986af05aafabc8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_482e3342609b68ce9b60719e50b6729c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_f2e1fee61def78719682d1f3927fb121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_664dba5a79b4bb28115ceff72ad926e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_b8355a88b7c93b8863b3ce731ebf9420.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_16caafcd41c77d79368b4985c51efb1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_c4b296dd6a012313b453e5ce76dd966b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_c641b9c4ef0fc18fe1aa335235d594af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_13deaddc2daf5e68ecf1423e0344fd7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_0a229e9d59c49dccebab9df2a288a93a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402093a2-ccab-5cdf-9b16-953d5eb0edbc/402093a2-ccab-5cdf-9b16-953d5eb0edbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/8b/0e8b906c64e84c39c3e636d110e8ba7c/pa/ZJ02157_4de1dad03b8ef08c75986af05aafabc8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 1.5 TSI ACT Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2020}
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-29 12:10:39 [auto1.nl] INFO: Saving data for ZJ02157: {'created_time': 1774786239.979658, 'last_price_update_time': 1774786239.979667, 'auction_closing_time': 1774883959.0}
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZJ02157') HTTP/1.1" 204 0
2026-03-29 12:10:40 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-29 12:10:40 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-29 12:10:40 [auto1.nl] INFO: Scrape type for ZL38920: 2
2026-03-29 12:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-29 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with scrape type 2
2026-03-29 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with scrape type 2
2026-03-29 12:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e, identifier: ZL38920
2026-03-29 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA59748/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:40 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME46694%27 HTTP/1.1" 200 None
2026-03-29 12:10:40 [auto1.nl] INFO: Scrape type for ME46694: 2
2026-03-29 12:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc710e56-03cd-55f4-b855-ecbe351af59d with identifier: ME46694
2026-03-29 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc710e56-03cd-55f4-b855-ecbe351af59d with scrape type 2
2026-03-29 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc710e56-03cd-55f4-b855-ecbe351af59d with scrape type 2
2026-03-29 12:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bc710e56-03cd-55f4-b855-ecbe351af59d, identifier: ME46694
2026-03-29 12:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-29 12:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920
2026-03-29 12:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e with identifier: ZL38920 to the API
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:29:04Z',
 'fuel_type': 'petrol',
 'id': 'd7e7c1e1-e3cb-5054-bd0d-6fa1a4df2d5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL38920',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 132275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-10',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2019}
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-29 12:10:40 [auto1.nl] INFO: Saving data for ZL38920: {'auction_closing_time': 1774884544.0, 'created_time': 1773232252.95277, 'last_price_update_time': 1774786240.522563}
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL38920') HTTP/1.1" 204 0
2026-03-29 12:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bc710e56-03cd-55f4-b855-ecbe351af59d with identifier: ME46694
2026-03-29 12:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bc710e56-03cd-55f4-b855-ecbe351af59d with identifier: ME46694
2026-03-29 12:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bc710e56-03cd-55f4-b855-ecbe351af59d with identifier: ME46694 to the API
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:57:49Z',
 'fuel_type': 'petrol',
 'id': 'bc710e56-03cd-55f4-b855-ecbe351af59d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME46694',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'Tribute',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-29',
 'seller_name': None,
 'title': 'Mazda Tribute 2.0 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2003}
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME46694%27 HTTP/1.1" 200 None
2026-03-29 12:10:40 [auto1.nl] INFO: Saving data for ME46694: {'auction_closing_time': 1774886269.0, 'created_time': 1774465826.316092, 'last_price_update_time': 1774786240.856281}
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME46694') HTTP/1.1" 204 0
2026-03-29 12:10:40 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-29 12:10:40 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-29 12:10:40 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-29 12:10:40 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-29 12:10:40 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ31943%27 HTTP/1.1" 200 None
2026-03-29 12:10:40 [auto1.nl] INFO: Scrape type for SZ31943: 2
2026-03-29 12:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaeda52c-7a74-55e9-9530-9f0f5fe57548 with identifier: SZ31943
2026-03-29 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaeda52c-7a74-55e9-9530-9f0f5fe57548 with scrape type 2
2026-03-29 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaeda52c-7a74-55e9-9530-9f0f5fe57548 with scrape type 2
2026-03-29 12:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aaeda52c-7a74-55e9-9530-9f0f5fe57548, identifier: SZ31943
2026-03-29 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG34346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c88083-54ae-5b55-a6af-60175998219d with identifier: NN80164
2026-03-29 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c88083-54ae-5b55-a6af-60175998219d with scrape type 1
2026-03-29 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b2c88083-54ae-5b55-a6af-60175998219d
2026-03-29 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F2d%252F962daaaf495cacc9d89e6b6c7a212486%252Fpa%252FNN80164_7d10de5a62cfdfae130b817ad50a4f63.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_7d10de5a62cfdfae130b817ad50a4f63.jpg already downloaded
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F2d%252F962daaaf495cacc9d89e6b6c7a212486%252Fpa%252FNN80164_387e1eae0e19b378d7d23498aa1c3011.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_387e1eae0e19b378d7d23498aa1c3011.jpg already downloaded
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F2d%252F962daaaf495cacc9d89e6b6c7a212486%252Fpa%252FNN80164_5216e94714313327dc19d24c192877ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_5216e94714313327dc19d24c192877ca.jpg already downloaded
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F2d%252F962daaaf495cacc9d89e6b6c7a212486%252Fpa%252FNN80164_ecdd80637c8bebffef02a9b8b921d694.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_ecdd80637c8bebffef02a9b8b921d694.jpg already downloaded
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F2d%252F962daaaf495cacc9d89e6b6c7a212486%252Fpa%252FNN80164_bb150ccb765e45501b81c62bd56cb900.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_bb150ccb765e45501b81c62bd56cb900.jpg already downloaded
2026-03-29 12:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b2c88083-54ae-5b55-a6af-60175998219d, identifier: NN80164
2026-03-29 12:10:41 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD44164%27 HTTP/1.1" 200 None
2026-03-29 12:10:41 [auto1.nl] INFO: Scrape type for YD44164: 2
2026-03-29 12:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5702375b-a4b7-5b55-8282-8633844fc3c5 with identifier: YD44164
2026-03-29 12:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5702375b-a4b7-5b55-8282-8633844fc3c5 with scrape type 2
2026-03-29 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5702375b-a4b7-5b55-8282-8633844fc3c5 with scrape type 2
2026-03-29 12:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5702375b-a4b7-5b55-8282-8633844fc3c5, identifier: YD44164
2026-03-29 12:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aaeda52c-7a74-55e9-9530-9f0f5fe57548 with identifier: SZ31943
2026-03-29 12:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aaeda52c-7a74-55e9-9530-9f0f5fe57548 with identifier: SZ31943
2026-03-29 12:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aaeda52c-7a74-55e9-9530-9f0f5fe57548 with identifier: SZ31943 to the API
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:59:20Z',
 'fuel_type': 'petrol',
 'id': 'aaeda52c-7a74-55e9-9530-9f0f5fe57548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ31943',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S4',
 'odometer': 262214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-02',
 'seller_name': None,
 'title': 'Audi S4 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ31943%27 HTTP/1.1" 200 None
2026-03-29 12:10:41 [auto1.nl] INFO: Saving data for SZ31943: {'auction_closing_time': 1774886360.0, 'created_time': 1773133309.725944, 'last_price_update_time': 1774786241.636636}
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SZ31943') HTTP/1.1" 204 0
2026-03-29 12:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b2c88083-54ae-5b55-a6af-60175998219d with identifier: NN80164
2026-03-29 12:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b2c88083-54ae-5b55-a6af-60175998219d with identifier: NN80164
2026-03-29 12:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b2c88083-54ae-5b55-a6af-60175998219d with identifier: NN80164 to the API
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN80164>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:44Z',
 'fuel_type': 'diesel',
 'id': 'b2c88083-54ae-5b55-a6af-60175998219d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '40ZSBK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN80164',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ssangyong',
 'model': 'Kyron',
 'odometer': 355885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_7d10de5a62cfdfae130b817ad50a4f63.jpg',
                'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_387e1eae0e19b378d7d23498aa1c3011.jpg',
                'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_5216e94714313327dc19d24c192877ca.jpg',
                'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_ecdd80637c8bebffef02a9b8b921d694.jpg',
                'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_bb150ccb765e45501b81c62bd56cb900.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c88083-54ae-5b55-a6af-60175998219d/b2c88083-54ae-5b55-a6af-60175998219d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_7d10de5a62cfdfae130b817ad50a4f63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c88083-54ae-5b55-a6af-60175998219d/b2c88083-54ae-5b55-a6af-60175998219d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_387e1eae0e19b378d7d23498aa1c3011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c88083-54ae-5b55-a6af-60175998219d/b2c88083-54ae-5b55-a6af-60175998219d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_5216e94714313327dc19d24c192877ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c88083-54ae-5b55-a6af-60175998219d/b2c88083-54ae-5b55-a6af-60175998219d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_ecdd80637c8bebffef02a9b8b921d694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c88083-54ae-5b55-a6af-60175998219d/b2c88083-54ae-5b55-a6af-60175998219d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/2d/962daaaf495cacc9d89e6b6c7a212486/pa/NN80164_bb150ccb765e45501b81c62bd56cb900.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Kyron 2.0 200 Xdi',
 'transmission': 'automatic',
 'trim': '200 Xdi',
 'year': 2008}
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN80164%27 HTTP/1.1" 200 None
2026-03-29 12:10:42 [auto1.nl] INFO: Saving data for NN80164: {'created_time': 1774786242.053043, 'last_price_update_time': 1774786242.053052, 'auction_closing_time': 1774883924.0}
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NN80164') HTTP/1.1" 204 0
2026-03-29 12:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5702375b-a4b7-5b55-8282-8633844fc3c5 with identifier: YD44164
2026-03-29 12:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5702375b-a4b7-5b55-8282-8633844fc3c5 with identifier: YD44164
2026-03-29 12:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5702375b-a4b7-5b55-8282-8633844fc3c5 with identifier: YD44164 to the API
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:59:08Z',
 'fuel_type': 'petrol',
 'id': '5702375b-a4b7-5b55-8282-8633844fc3c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD44164',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Voyager',
 'odometer': 189039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-11',
 'seller_name': None,
 'title': 'Chrysler Voyager 3.3 V6 LX',
 'transmission': 'automatic',
 'trim': 'LX',
 'year': 2006}
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD44164%27 HTTP/1.1" 200 None
2026-03-29 12:10:42 [auto1.nl] INFO: Saving data for YD44164: {'auction_closing_time': 1774886348.0, 'created_time': 1773232091.673362, 'last_price_update_time': 1774786242.388338}
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YD44164') HTTP/1.1" 204 0
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-29 12:10:42 [auto1.nl] INFO: Scrape type for TU57635: 2
2026-03-29 12:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-29 12:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6df5f0fb-4821-5c39-b3f7-243f340d6789 with scrape type 2
2026-03-29 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6df5f0fb-4821-5c39-b3f7-243f340d6789 with scrape type 2
2026-03-29 12:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6df5f0fb-4821-5c39-b3f7-243f340d6789, identifier: TU57635
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX76007%27 HTTP/1.1" 200 None
2026-03-29 12:10:42 [auto1.nl] INFO: Scrape type for EX76007: 1
2026-03-29 12:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-29 12:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-29 12:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635 to the API
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:20:33Z',
 'fuel_type': 'petrol',
 'id': '6df5f0fb-4821-5c39-b3f7-243f340d6789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU57635',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 276474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-14',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-29 12:10:42 [auto1.nl] INFO: Saving data for TU57635: {'auction_closing_time': 1774884033.0, 'created_time': 1773232418.772815, 'last_price_update_time': 1774786242.83327}
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU57635') HTTP/1.1" 204 0
2026-03-29 12:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH35225%27 HTTP/1.1" 200 None
2026-03-29 12:10:42 [auto1.nl] INFO: Scrape type for RH35225: 2
2026-03-29 12:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984b02be-0cd5-581c-8236-1c5b6628e4dd with identifier: RH35225
2026-03-29 12:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984b02be-0cd5-581c-8236-1c5b6628e4dd with scrape type 2
2026-03-29 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 984b02be-0cd5-581c-8236-1c5b6628e4dd with scrape type 2
2026-03-29 12:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 984b02be-0cd5-581c-8236-1c5b6628e4dd, identifier: RH35225
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-29 12:10:42 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SU37312%27 HTTP/1.1" 200 None
2026-03-29 12:10:42 [auto1.nl] INFO: Scrape type for SU37312: 2
2026-03-29 12:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 749a781b-3c64-5b09-a02e-0b519e2f21de with identifier: SU37312
2026-03-29 12:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 749a781b-3c64-5b09-a02e-0b519e2f21de with scrape type 2
2026-03-29 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 749a781b-3c64-5b09-a02e-0b519e2f21de with scrape type 2
2026-03-29 12:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 749a781b-3c64-5b09-a02e-0b519e2f21de, identifier: SU37312
2026-03-29 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 984b02be-0cd5-581c-8236-1c5b6628e4dd with identifier: RH35225
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 984b02be-0cd5-581c-8236-1c5b6628e4dd with identifier: RH35225
2026-03-29 12:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 984b02be-0cd5-581c-8236-1c5b6628e4dd with identifier: RH35225 to the API
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:32Z',
 'fuel_type': 'diesel',
 'id': '984b02be-0cd5-581c-8236-1c5b6628e4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH35225',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 343519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-26',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH35225%27 HTTP/1.1" 200 None
2026-03-29 12:10:43 [auto1.nl] INFO: Saving data for RH35225: {'auction_closing_time': 1774885472.0, 'created_time': 1773232378.24073, 'last_price_update_time': 1774786243.496316}
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RH35225') HTTP/1.1" 204 0
2026-03-29 12:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 749a781b-3c64-5b09-a02e-0b519e2f21de with identifier: SU37312
2026-03-29 12:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 749a781b-3c64-5b09-a02e-0b519e2f21de with identifier: SU37312
2026-03-29 12:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 749a781b-3c64-5b09-a02e-0b519e2f21de with identifier: SU37312 to the API
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:02Z',
 'fuel_type': 'petrol',
 'id': '749a781b-3c64-5b09-a02e-0b519e2f21de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU37312',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 31461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-06',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo Google',
 'transmission': 'automatic',
 'trim': 'Google',
 'year': 2021}
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SU37312%27 HTTP/1.1" 200 None
2026-03-29 12:10:43 [auto1.nl] INFO: Saving data for SU37312: {'auction_closing_time': 1774886282.0, 'created_time': 1774552297.960729, 'last_price_update_time': 1774786243.892572}
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SU37312') HTTP/1.1" 204 0
2026-03-29 12:10:43 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX09180%27 HTTP/1.1" 200 None
2026-03-29 12:10:43 [auto1.nl] INFO: Scrape type for CX09180: 2
2026-03-29 12:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa43f4b5-903c-58ff-a359-b15ab45f8476 with identifier: CX09180
2026-03-29 12:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa43f4b5-903c-58ff-a359-b15ab45f8476 with scrape type 2
2026-03-29 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa43f4b5-903c-58ff-a359-b15ab45f8476 with scrape type 2
2026-03-29 12:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aa43f4b5-903c-58ff-a359-b15ab45f8476, identifier: CX09180
2026-03-29 12:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aa43f4b5-903c-58ff-a359-b15ab45f8476 with identifier: CX09180
2026-03-29 12:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aa43f4b5-903c-58ff-a359-b15ab45f8476 with identifier: CX09180
2026-03-29 12:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aa43f4b5-903c-58ff-a359-b15ab45f8476 with identifier: CX09180 to the API
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:18:12Z',
 'fuel_type': 'petrol',
 'id': 'aa43f4b5-903c-58ff-a359-b15ab45f8476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX09180',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 105301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Generation Four BlueMotion',
 'transmission': 'manual',
 'trim': 'Generation Four BlueMotion',
 'year': 2016}
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX09180%27 HTTP/1.1" 200 None
2026-03-29 12:10:44 [auto1.nl] INFO: Saving data for CX09180: {'auction_closing_time': 1774883892.0, 'created_time': 1774379561.281164, 'last_price_update_time': 1774786244.338815}
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CX09180') HTTP/1.1" 204 0
2026-03-29 12:10:44 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ14164%27 HTTP/1.1" 200 None
2026-03-29 12:10:44 [auto1.nl] INFO: Scrape type for BZ14164: 2
2026-03-29 12:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8ac7e61-d23a-5894-ba42-52cf15c82050 with identifier: BZ14164
2026-03-29 12:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ac7e61-d23a-5894-ba42-52cf15c82050 with scrape type 2
2026-03-29 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8ac7e61-d23a-5894-ba42-52cf15c82050 with scrape type 2
2026-03-29 12:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d8ac7e61-d23a-5894-ba42-52cf15c82050, identifier: BZ14164
2026-03-29 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d8ac7e61-d23a-5894-ba42-52cf15c82050 with identifier: BZ14164
2026-03-29 12:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d8ac7e61-d23a-5894-ba42-52cf15c82050 with identifier: BZ14164
2026-03-29 12:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d8ac7e61-d23a-5894-ba42-52cf15c82050 with identifier: BZ14164 to the API
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:39Z',
 'fuel_type': 'diesel',
 'id': 'd8ac7e61-d23a-5894-ba42-52cf15c82050',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ14164',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 246118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-04',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2012}
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ14164%27 HTTP/1.1" 200 None
2026-03-29 12:10:44 [auto1.nl] INFO: Saving data for BZ14164: {'auction_closing_time': 1774885119.0, 'created_time': 1773232311.560557, 'last_price_update_time': 1774786244.792399}
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ14164') HTTP/1.1" 204 0
2026-03-29 12:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK38734> (referer: https://www.auto1.com/v1/car-details-view/RK38734/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX02211> (referer: https://www.auto1.com/v1/car-details-view/LX02211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB25892> (referer: https://www.auto1.com/v1/car-details-view/YB25892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:44 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-29 12:10:44 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-29 12:10:44 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-29 12:10:44 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-29 12:10:44 [auto1.nl] INFO: Scrape type for GD44915: 2
2026-03-29 12:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-29 12:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8687cf15-7688-575b-9acb-f780961e2d6b with scrape type 2
2026-03-29 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8687cf15-7688-575b-9acb-f780961e2d6b with scrape type 2
2026-03-29 12:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8687cf15-7688-575b-9acb-f780961e2d6b, identifier: GD44915
2026-03-29 12:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-29 12:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-29 12:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915 to the API
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:15:36Z',
 'fuel_type': 'petrol',
 'id': '8687cf15-7688-575b-9acb-f780961e2d6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD44915',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 53894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-04',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2022}
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-29 12:10:45 [auto1.nl] INFO: Saving data for GD44915: {'auction_closing_time': 1774883736.0, 'created_time': 1774552282.374843, 'last_price_update_time': 1774786245.245071}
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD44915') HTTP/1.1" 204 0
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC01356%27 HTTP/1.1" 200 None
2026-03-29 12:10:45 [auto1.nl] INFO: Scrape type for AC01356: 2
2026-03-29 12:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cef1e56-06b3-57ce-a00f-19d4172f2684 with identifier: AC01356
2026-03-29 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cef1e56-06b3-57ce-a00f-19d4172f2684 with scrape type 2
2026-03-29 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cef1e56-06b3-57ce-a00f-19d4172f2684 with scrape type 2
2026-03-29 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3cef1e56-06b3-57ce-a00f-19d4172f2684, identifier: AC01356
2026-03-29 12:10:45 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3cef1e56-06b3-57ce-a00f-19d4172f2684 with identifier: AC01356
2026-03-29 12:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3cef1e56-06b3-57ce-a00f-19d4172f2684 with identifier: AC01356
2026-03-29 12:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3cef1e56-06b3-57ce-a00f-19d4172f2684 with identifier: AC01356 to the API
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 575,
 'expiration_date': '2026-03-30T15:46:05Z',
 'fuel_type': 'petrol',
 'id': '3cef1e56-06b3-57ce-a00f-19d4172f2684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC01356',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 137398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'BMW X6 M',
 'transmission': 'automatic',
 'trim': 'BW',
 'year': 2017}
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC01356%27 HTTP/1.1" 200 None
2026-03-29 12:10:45 [auto1.nl] INFO: Saving data for AC01356: {'auction_closing_time': 1774885565.0, 'created_time': 1773134219.261115, 'last_price_update_time': 1774786245.774122}
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AC01356') HTTP/1.1" 204 0
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-29 12:10:45 [auto1.nl] INFO: Scrape type for JL68792: 2
2026-03-29 12:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-29 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with scrape type 2
2026-03-29 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with scrape type 2
2026-03-29 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5dbde58-d27d-5136-84c9-f5b5d801d9b1, identifier: JL68792
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ99279%27 HTTP/1.1" 200 None
2026-03-29 12:10:45 [auto1.nl] INFO: Scrape type for DJ99279: 0
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20154%27 HTTP/1.1" 200 None
2026-03-29 12:10:45 [auto1.nl] INFO: Scrape type for LZ20154: 0
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW21106%27 HTTP/1.1" 200 None
2026-03-29 12:10:45 [auto1.nl] INFO: Scrape type for GW21106: 0
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV89778%27 HTTP/1.1" 200 None
2026-03-29 12:10:45 [auto1.nl] INFO: Scrape type for VV89778: 0
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-29 12:10:45 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-29 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ29701%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for XZ29701: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UM83404%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for UM83404: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for NV18219: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for SA79399: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for FZ85660: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for JG46150: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for SV00912: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for JN77730: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for AX06352: 0
2026-03-29 12:10:46 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Scrape type for YT76844: 0
2026-03-29 12:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC17693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 12:10:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-29 12:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792 to the API
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-30T15:02:30Z',
 'fuel_type': 'hybrid',
 'id': 'e5dbde58-d27d-5136-84c9-f5b5d801d9b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL68792',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 231516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [auto1.nl] INFO: Saving data for JL68792: {'auction_closing_time': 1774882950.0, 'created_time': 1773302384.6079, 'last_price_update_time': 1774786246.863239}
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JL68792') HTTP/1.1" 204 0
2026-03-29 12:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with identifier: RK38734
2026-03-29 12:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with scrape type 1
2026-03-29 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad13d8cf-3306-56fe-8ab9-a7eef1ab0000
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_b4f71e4e34d550c9cfe277aa07633f47.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_b4f71e4e34d550c9cfe277aa07633f47.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_3c1252dc9255cee152a60d5ea08faa02.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_3c1252dc9255cee152a60d5ea08faa02.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_f57c624fac16b2e525ddf051ebff3380.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_f57c624fac16b2e525ddf051ebff3380.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_53e946f58e0b1dfb0f0ba3656ae90d7c.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_53e946f58e0b1dfb0f0ba3656ae90d7c.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_ad5e6317323dc0891daabbaff60843d6.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_ad5e6317323dc0891daabbaff60843d6.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_c86b067ced1816bf9c2872e1e253dc43.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_c86b067ced1816bf9c2872e1e253dc43.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_0f6a14d9013a578c016abe0a596ebb22.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_0f6a14d9013a578c016abe0a596ebb22.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_67b65c1134811db2f36d85f1552c3dd9.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_67b65c1134811db2f36d85f1552c3dd9.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_f701383e13fba0f121564d1c7e6eb2e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_f701383e13fba0f121564d1c7e6eb2e3.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F38%252F8e38e9112a3518480c271b097c00cda8%252Fpa%252FRK38734_4c73d373714c810f6389ad761062334d.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_4c73d373714c810f6389ad761062334d.jpg already downloaded
2026-03-29 12:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000, identifier: RK38734
2026-03-29 12:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc1629e9-7e13-5408-8c97-38286eb63c42 with identifier: LX02211
2026-03-29 12:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc1629e9-7e13-5408-8c97-38286eb63c42 with scrape type 1
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc1629e9-7e13-5408-8c97-38286eb63c42
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_9a381b383d963be756eac79ad8006b28.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_9a381b383d963be756eac79ad8006b28.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_eb811ffd5de56319038c3261e8f16a15.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_eb811ffd5de56319038c3261e8f16a15.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_ea1fe5d19bab10135092a4fe3442a7fe.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_ea1fe5d19bab10135092a4fe3442a7fe.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_de4fb79176b840b8426eab31598de7be.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_de4fb79176b840b8426eab31598de7be.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_76e5cd4b5192f64d0762876b1877d8c8.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_76e5cd4b5192f64d0762876b1877d8c8.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_fe1cf14974f8399f6765d4bdd62fa75c.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_fe1cf14974f8399f6765d4bdd62fa75c.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_97dd813f6b45215757dee8ed37439a39.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_97dd813f6b45215757dee8ed37439a39.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_727cb45a78a43a9d8cbf261824ea3804.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_727cb45a78a43a9d8cbf261824ea3804.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_0fd6290a95a440cfb376cdba440274f5.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_0fd6290a95a440cfb376cdba440274f5.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fcb%252F39cbbf1b067996aece62a1e539647c8b%252Fpa%252FLX02211_9f278bf229da5e98a3e39794501356b7.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_9f278bf229da5e98a3e39794501356b7.jpg already downloaded
2026-03-29 12:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cc1629e9-7e13-5408-8c97-38286eb63c42, identifier: LX02211
2026-03-29 12:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1966e311-745f-514d-b105-b853d9b9ae01 with identifier: YB25892
2026-03-29 12:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1966e311-745f-514d-b105-b853d9b9ae01 with scrape type 1
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1966e311-745f-514d-b105-b853d9b9ae01
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_083f680040615743ac6081699f9e64de.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_083f680040615743ac6081699f9e64de.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_695f7ee171c8cb1c5284198c3d461a24.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_695f7ee171c8cb1c5284198c3d461a24.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_cb83199cfcdffc37685554de573c9766.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_cb83199cfcdffc37685554de573c9766.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_8da1d492f7bd65ba7e6a244a819d8bf4.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_8da1d492f7bd65ba7e6a244a819d8bf4.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_7dc3dd6b63c05eb08e0c1e53aa95f21c.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_7dc3dd6b63c05eb08e0c1e53aa95f21c.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_b3ed54a1bad3d754677d2982550cb89a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_b3ed54a1bad3d754677d2982550cb89a.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_ef52fca2898ad6742d28954345e3ad51.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_ef52fca2898ad6742d28954345e3ad51.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_c781adec634dfbadc6c79c47355dc6c1.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_c781adec634dfbadc6c79c47355dc6c1.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_9ad73ccd0433b55dd1f67f253e924d99.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_9ad73ccd0433b55dd1f67f253e924d99.jpg already downloaded
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fd7%252F7fd7fddc0bb914ffc68eb4fb0161033b%252Fpa%252FYB25892_135ca0f93b43d4403aa5c0f5e9ec9cae.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_135ca0f93b43d4403aa5c0f5e9ec9cae.jpg already downloaded
2026-03-29 12:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1966e311-745f-514d-b105-b853d9b9ae01, identifier: YB25892
2026-03-29 12:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:47 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP11309%27 HTTP/1.1" 200 None
2026-03-29 12:10:47 [auto1.nl] INFO: Scrape type for VP11309: 2
2026-03-29 12:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1dfe09c-faa6-5841-96d6-4109a30f3a3b with identifier: VP11309
2026-03-29 12:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1dfe09c-faa6-5841-96d6-4109a30f3a3b with scrape type 2
2026-03-29 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1dfe09c-faa6-5841-96d6-4109a30f3a3b with scrape type 2
2026-03-29 12:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1dfe09c-faa6-5841-96d6-4109a30f3a3b, identifier: VP11309
2026-03-29 12:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with identifier: RK38734
2026-03-29 12:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with identifier: RK38734
2026-03-29 12:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad13d8cf-3306-56fe-8ab9-a7eef1ab0000 with identifier: RK38734 to the API
2026-03-29 12:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK38734>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:45:06Z',
 'fuel_type': 'petrol',
 'id': 'ad13d8cf-3306-56fe-8ab9-a7eef1ab0000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L907SK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK38734',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 126742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_b4f71e4e34d550c9cfe277aa07633f47.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_3c1252dc9255cee152a60d5ea08faa02.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_f57c624fac16b2e525ddf051ebff3380.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_53e946f58e0b1dfb0f0ba3656ae90d7c.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_ad5e6317323dc0891daabbaff60843d6.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_c86b067ced1816bf9c2872e1e253dc43.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_0f6a14d9013a578c016abe0a596ebb22.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_67b65c1134811db2f36d85f1552c3dd9.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_f701383e13fba0f121564d1c7e6eb2e3.jpg',
                'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_4c73d373714c810f6389ad761062334d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_b4f71e4e34d550c9cfe277aa07633f47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_3c1252dc9255cee152a60d5ea08faa02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_f57c624fac16b2e525ddf051ebff3380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_53e946f58e0b1dfb0f0ba3656ae90d7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_ad5e6317323dc0891daabbaff60843d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_c86b067ced1816bf9c2872e1e253dc43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_0f6a14d9013a578c016abe0a596ebb22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_67b65c1134811db2f36d85f1552c3dd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_f701383e13fba0f121564d1c7e6eb2e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad13d8cf-3306-56fe-8ab9-a7eef1ab0000/ad13d8cf-3306-56fe-8ab9-a7eef1ab0000_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/38/8e38e9112a3518480c271b097c00cda8/pa/RK38734_4c73d373714c810f6389ad761062334d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-29 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK38734%27 HTTP/1.1" 200 None
2026-03-29 12:10:48 [auto1.nl] INFO: Saving data for RK38734: {'created_time': 1774786248.296718, 'last_price_update_time': 1774786248.296729, 'auction_closing_time': 1774885506.0}
2026-03-29 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RK38734') HTTP/1.1" 204 0
2026-03-29 12:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cc1629e9-7e13-5408-8c97-38286eb63c42 with identifier: LX02211
2026-03-29 12:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cc1629e9-7e13-5408-8c97-38286eb63c42 with identifier: LX02211
2026-03-29 12:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cc1629e9-7e13-5408-8c97-38286eb63c42 with identifier: LX02211 to the API
2026-03-29 12:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX02211>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:26Z',
 'fuel_type': 'petrol',
 'id': 'cc1629e9-7e13-5408-8c97-38286eb63c42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ZJ183X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX02211',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 131758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_9a381b383d963be756eac79ad8006b28.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_eb811ffd5de56319038c3261e8f16a15.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_ea1fe5d19bab10135092a4fe3442a7fe.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_de4fb79176b840b8426eab31598de7be.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_76e5cd4b5192f64d0762876b1877d8c8.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_fe1cf14974f8399f6765d4bdd62fa75c.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_97dd813f6b45215757dee8ed37439a39.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_727cb45a78a43a9d8cbf261824ea3804.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_0fd6290a95a440cfb376cdba440274f5.jpg',
                'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_9f278bf229da5e98a3e39794501356b7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_9a381b383d963be756eac79ad8006b28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_eb811ffd5de56319038c3261e8f16a15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1251580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_ea1fe5d19bab10135092a4fe3442a7fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439547,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_de4fb79176b840b8426eab31598de7be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_76e5cd4b5192f64d0762876b1877d8c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1206995,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_fe1cf14974f8399f6765d4bdd62fa75c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440461,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_97dd813f6b45215757dee8ed37439a39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_727cb45a78a43a9d8cbf261824ea3804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1260416,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_0fd6290a95a440cfb376cdba440274f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1629e9-7e13-5408-8c97-38286eb63c42/cc1629e9-7e13-5408-8c97-38286eb63c42_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/cb/39cbbf1b067996aece62a1e539647c8b/pa/LX02211_9f278bf229da5e98a3e39794501356b7.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX02211%27 HTTP/1.1" 200 None
2026-03-29 12:10:49 [auto1.nl] INFO: Saving data for LX02211: {'created_time': 1774786249.551827, 'last_price_update_time': 1774786249.551838, 'auction_closing_time': 1774884866.0}
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX02211') HTTP/1.1" 204 0
2026-03-29 12:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1966e311-745f-514d-b105-b853d9b9ae01 with identifier: YB25892
2026-03-29 12:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1966e311-745f-514d-b105-b853d9b9ae01 with identifier: YB25892
2026-03-29 12:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1966e311-745f-514d-b105-b853d9b9ae01 with identifier: YB25892 to the API
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB25892>
{'auction_title': '',
 'c_o_2_emission_value': 258,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '4.4L',
 'engine_horse_power': 575,
 'expiration_date': '2026-03-30T15:51:22Z',
 'fuel_type': 'petrol',
 'id': '1966e311-745f-514d-b105-b853d9b9ae01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Z263BV',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB25892',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 159647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_083f680040615743ac6081699f9e64de.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_695f7ee171c8cb1c5284198c3d461a24.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_cb83199cfcdffc37685554de573c9766.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_8da1d492f7bd65ba7e6a244a819d8bf4.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_7dc3dd6b63c05eb08e0c1e53aa95f21c.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_b3ed54a1bad3d754677d2982550cb89a.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_ef52fca2898ad6742d28954345e3ad51.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_c781adec634dfbadc6c79c47355dc6c1.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_9ad73ccd0433b55dd1f67f253e924d99.jpg',
                'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_135ca0f93b43d4403aa5c0f5e9ec9cae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_083f680040615743ac6081699f9e64de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_695f7ee171c8cb1c5284198c3d461a24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_cb83199cfcdffc37685554de573c9766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_8da1d492f7bd65ba7e6a244a819d8bf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_7dc3dd6b63c05eb08e0c1e53aa95f21c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_b3ed54a1bad3d754677d2982550cb89a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_ef52fca2898ad6742d28954345e3ad51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_c781adec634dfbadc6c79c47355dc6c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_9ad73ccd0433b55dd1f67f253e924d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1966e311-745f-514d-b105-b853d9b9ae01/1966e311-745f-514d-b105-b853d9b9ae01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/d7/7fd7fddc0bb914ffc68eb4fb0161033b/pa/YB25892_135ca0f93b43d4403aa5c0f5e9ec9cae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 M',
 'transmission': 'automatic',
 'trim': 'BW',
 'year': 2017}
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB25892%27 HTTP/1.1" 200 None
2026-03-29 12:10:49 [auto1.nl] INFO: Saving data for YB25892: {'created_time': 1774786249.859549, 'last_price_update_time': 1774786249.85956, 'auction_closing_time': 1774885882.0}
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB25892') HTTP/1.1" 204 0
2026-03-29 12:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1dfe09c-faa6-5841-96d6-4109a30f3a3b with identifier: VP11309
2026-03-29 12:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1dfe09c-faa6-5841-96d6-4109a30f3a3b with identifier: VP11309
2026-03-29 12:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1dfe09c-faa6-5841-96d6-4109a30f3a3b with identifier: VP11309 to the API
2026-03-29 12:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:55:06Z',
 'fuel_type': 'petrol',
 'id': 'a1dfe09c-faa6-5841-96d6-4109a30f3a3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP11309',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 190367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-24',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP11309%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [auto1.nl] INFO: Saving data for VP11309: {'auction_closing_time': 1774886106.0, 'created_time': 1773232298.619375, 'last_price_update_time': 1774786250.183601}
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VP11309') HTTP/1.1" 204 0
2026-03-29 12:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW17095> (referer: https://www.auto1.com/v1/car-details-view/XW17095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [auto1.nl] INFO: Scrape type for ZY88945: 2
2026-03-29 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-29 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86f80907-8290-5b49-b95c-ebc0855b07fe with scrape type 2
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86f80907-8290-5b49-b95c-ebc0855b07fe with scrape type 2
2026-03-29 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 86f80907-8290-5b49-b95c-ebc0855b07fe, identifier: ZY88945
2026-03-29 12:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA59748> (referer: https://www.auto1.com/v1/car-details-view/NA59748/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG34346> (referer: https://www.auto1.com/v1/car-details-view/MG34346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-29 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945
2026-03-29 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 86f80907-8290-5b49-b95c-ebc0855b07fe with identifier: ZY88945 to the API
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:17:00Z',
 'fuel_type': 'petrol',
 'id': '86f80907-8290-5b49-b95c-ebc0855b07fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY88945',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 221775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-31',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 R-Design 2WD',
 'transmission': 'manual',
 'trim': 'R-Design 2WD',
 'year': 2012}
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [auto1.nl] INFO: Saving data for ZY88945: {'auction_closing_time': 1774883820.0, 'created_time': 1773131940.100476, 'last_price_update_time': 1774786250.623352}
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZY88945') HTTP/1.1" 204 0
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [auto1.nl] INFO: Scrape type for KX21734: 0
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR57884%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [auto1.nl] INFO: Scrape type for HR57884: 0
2026-03-29 12:10:50 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-29 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-29 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d78efdc7-bf27-5ebc-b817-2318bf5d29bf with scrape type 1
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d78efdc7-bf27-5ebc-b817-2318bf5d29bf
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_5f7dc78c89a45f10d0f37b02b9b72b42.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_5f7dc78c89a45f10d0f37b02b9b72b42.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_48a3b427e6a8e37f999ff43214800ea9.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_48a3b427e6a8e37f999ff43214800ea9.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_975db207e28a5c3991ac9407b38ef603.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_975db207e28a5c3991ac9407b38ef603.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_59525d5054e4234ab92bdab95ba19839.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_59525d5054e4234ab92bdab95ba19839.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_02312ed5f470bd001583afaa94310136.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_02312ed5f470bd001583afaa94310136.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_7abc61da7f90d378236fbbf40ac38ea4.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_7abc61da7f90d378236fbbf40ac38ea4.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_192831a53d1c0c114db964fc6d7c4813.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_192831a53d1c0c114db964fc6d7c4813.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_23f86fde44ae9073008303414bdd2ca6.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_23f86fde44ae9073008303414bdd2ca6.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_d3f024e993953a386c0c21496c5f37a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_d3f024e993953a386c0c21496c5f37a0.jpg already downloaded
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F85%252F1d85e1661321ff53ecde1e110a7a92f9%252Fpa%252FXW17095_c617f73ec57dd2717393c6629e5cb7c6.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_c617f73ec57dd2717393c6629e5cb7c6.jpg already downloaded
2026-03-29 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d78efdc7-bf27-5ebc-b817-2318bf5d29bf, identifier: XW17095
2026-03-29 12:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with identifier: NA59748
2026-03-29 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with scrape type 1
2026-03-29 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 303f23bd-cd04-5501-ac32-2d79d6b5bdbc
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_14bd30f3e0b260c29f8ba0c41947185d.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_14bd30f3e0b260c29f8ba0c41947185d.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_507f99d8d502beeda439e64aeb35a45f.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_507f99d8d502beeda439e64aeb35a45f.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_1f6a8c0598b050513a188cfad39b6d66.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_1f6a8c0598b050513a188cfad39b6d66.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_31be72cb6d28eef4bc5cc561ce7958b4.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_31be72cb6d28eef4bc5cc561ce7958b4.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_3d8cb07472e4f4b777e206d9d0add932.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_3d8cb07472e4f4b777e206d9d0add932.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_b6b76a11317f33b3e7aabfe67620210b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_b6b76a11317f33b3e7aabfe67620210b.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_4fa285d6195daf3736515bf72b40935c.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_4fa285d6195daf3736515bf72b40935c.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_0716c4a96a40ec3a9da61d36974e9246.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_0716c4a96a40ec3a9da61d36974e9246.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_bc2402d64c7209da8f791be0e3a76483.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_bc2402d64c7209da8f791be0e3a76483.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F19%252F2f193a13a55b6e65fc0e296b7747a8ee%252Fpa%252FNA59748_64cc063e0eb00321bcff92933422c597.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_64cc063e0eb00321bcff92933422c597.jpg already downloaded
2026-03-29 12:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc, identifier: NA59748
2026-03-29 12:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b0addbc-d695-5dc3-9e50-13aa329285bc with identifier: MG34346
2026-03-29 12:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b0addbc-d695-5dc3-9e50-13aa329285bc with scrape type 1
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b0addbc-d695-5dc3-9e50-13aa329285bc
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_43e9070bcbdfe2ba9f1ba1c9a98f9e5d.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_43e9070bcbdfe2ba9f1ba1c9a98f9e5d.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_c7ab0f0b80d3fd03ab360719989fb0db.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_c7ab0f0b80d3fd03ab360719989fb0db.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_7417680b502188322d2046fa8f9545ac.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_7417680b502188322d2046fa8f9545ac.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_765a6f327bf87db404259d37b2539422.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_765a6f327bf87db404259d37b2539422.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_418844a97e7a8448c0362052de02a7ee.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_418844a97e7a8448c0362052de02a7ee.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_ee029bf311ffdb520047b4144d855d7e.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_ee029bf311ffdb520047b4144d855d7e.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_8313a40685b89229e8b70c24644095db.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_8313a40685b89229e8b70c24644095db.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_fbc7ee4711345d638acca7b566e00733.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_fbc7ee4711345d638acca7b566e00733.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_5c4da95e0fa56bbea59295ca8e7355f8.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_5c4da95e0fa56bbea59295ca8e7355f8.jpg already downloaded
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F89%252F8f89122e4c6d785167f2491c30002da5%252Fpa%252FMG34346_f142bc5008df2b08f907421b213ef432.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_f142bc5008df2b08f907421b213ef432.jpg already downloaded
2026-03-29 12:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4b0addbc-d695-5dc3-9e50-13aa329285bc, identifier: MG34346
2026-03-29 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-29 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-29 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095 to the API
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XW17095>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:43:29Z',
 'fuel_type': 'petrol',
 'id': 'd78efdc7-bf27-5ebc-b817-2318bf5d29bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R149NX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW17095',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 56194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_5f7dc78c89a45f10d0f37b02b9b72b42.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_48a3b427e6a8e37f999ff43214800ea9.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_975db207e28a5c3991ac9407b38ef603.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_59525d5054e4234ab92bdab95ba19839.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_02312ed5f470bd001583afaa94310136.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_7abc61da7f90d378236fbbf40ac38ea4.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_192831a53d1c0c114db964fc6d7c4813.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_23f86fde44ae9073008303414bdd2ca6.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_d3f024e993953a386c0c21496c5f37a0.jpg',
                'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_c617f73ec57dd2717393c6629e5cb7c6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_5f7dc78c89a45f10d0f37b02b9b72b42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_48a3b427e6a8e37f999ff43214800ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_975db207e28a5c3991ac9407b38ef603.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_59525d5054e4234ab92bdab95ba19839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_02312ed5f470bd001583afaa94310136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_7abc61da7f90d378236fbbf40ac38ea4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_192831a53d1c0c114db964fc6d7c4813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_23f86fde44ae9073008303414bdd2ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_d3f024e993953a386c0c21496c5f37a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d78efdc7-bf27-5ebc-b817-2318bf5d29bf/d78efdc7-bf27-5ebc-b817-2318bf5d29bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/85/1d85e1661321ff53ecde1e110a7a92f9/pa/XW17095_c617f73ec57dd2717393c6629e5cb7c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW17095%27 HTTP/1.1" 200 None
2026-03-29 12:10:51 [auto1.nl] INFO: Saving data for XW17095: {'created_time': 1774786251.981029, 'last_price_update_time': 1774786251.981039, 'auction_closing_time': 1774885409.0}
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW17095') HTTP/1.1" 204 0
2026-03-29 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with identifier: NA59748
2026-03-29 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with identifier: NA59748
2026-03-29 12:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 303f23bd-cd04-5501-ac32-2d79d6b5bdbc with identifier: NA59748 to the API
2026-03-29 12:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NA59748>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:14:49Z',
 'fuel_type': 'petrol',
 'id': '303f23bd-cd04-5501-ac32-2d79d6b5bdbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GBL45G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA59748',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 132701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_14bd30f3e0b260c29f8ba0c41947185d.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_507f99d8d502beeda439e64aeb35a45f.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_1f6a8c0598b050513a188cfad39b6d66.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_31be72cb6d28eef4bc5cc561ce7958b4.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_3d8cb07472e4f4b777e206d9d0add932.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_b6b76a11317f33b3e7aabfe67620210b.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_4fa285d6195daf3736515bf72b40935c.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_0716c4a96a40ec3a9da61d36974e9246.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_bc2402d64c7209da8f791be0e3a76483.jpg',
                'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_64cc063e0eb00321bcff92933422c597.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_14bd30f3e0b260c29f8ba0c41947185d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_507f99d8d502beeda439e64aeb35a45f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_1f6a8c0598b050513a188cfad39b6d66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_31be72cb6d28eef4bc5cc561ce7958b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_3d8cb07472e4f4b777e206d9d0add932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_b6b76a11317f33b3e7aabfe67620210b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_4fa285d6195daf3736515bf72b40935c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_0716c4a96a40ec3a9da61d36974e9246.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_bc2402d64c7209da8f791be0e3a76483.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303f23bd-cd04-5501-ac32-2d79d6b5bdbc/303f23bd-cd04-5501-ac32-2d79d6b5bdbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/19/2f193a13a55b6e65fc0e296b7747a8ee/pa/NA59748_64cc063e0eb00321bcff92933422c597.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-29 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA59748%27 HTTP/1.1" 200 None
2026-03-29 12:10:52 [auto1.nl] INFO: Saving data for NA59748: {'created_time': 1774786252.929868, 'last_price_update_time': 1774786252.929882, 'auction_closing_time': 1774883689.0}
2026-03-29 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA59748') HTTP/1.1" 204 0
2026-03-29 12:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4b0addbc-d695-5dc3-9e50-13aa329285bc with identifier: MG34346
2026-03-29 12:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4b0addbc-d695-5dc3-9e50-13aa329285bc with identifier: MG34346
2026-03-29 12:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4b0addbc-d695-5dc3-9e50-13aa329285bc with identifier: MG34346 to the API
2026-03-29 12:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MG34346>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:31:38Z',
 'fuel_type': 'petrol',
 'id': '4b0addbc-d695-5dc3-9e50-13aa329285bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R682KN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG34346',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '2er',
 'odometer': 99134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_43e9070bcbdfe2ba9f1ba1c9a98f9e5d.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_c7ab0f0b80d3fd03ab360719989fb0db.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_7417680b502188322d2046fa8f9545ac.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_765a6f327bf87db404259d37b2539422.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_418844a97e7a8448c0362052de02a7ee.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_ee029bf311ffdb520047b4144d855d7e.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_8313a40685b89229e8b70c24644095db.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_fbc7ee4711345d638acca7b566e00733.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_5c4da95e0fa56bbea59295ca8e7355f8.jpg',
                'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_f142bc5008df2b08f907421b213ef432.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_43e9070bcbdfe2ba9f1ba1c9a98f9e5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_c7ab0f0b80d3fd03ab360719989fb0db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_7417680b502188322d2046fa8f9545ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_765a6f327bf87db404259d37b2539422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_418844a97e7a8448c0362052de02a7ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_ee029bf311ffdb520047b4144d855d7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_8313a40685b89229e8b70c24644095db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_fbc7ee4711345d638acca7b566e00733.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_5c4da95e0fa56bbea59295ca8e7355f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0addbc-d695-5dc3-9e50-13aa329285bc/4b0addbc-d695-5dc3-9e50-13aa329285bc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/89/8f89122e4c6d785167f2491c30002da5/pa/MG34346_f142bc5008df2b08f907421b213ef432.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-29 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MG34346%27 HTTP/1.1" 200 None
2026-03-29 12:10:53 [auto1.nl] INFO: Saving data for MG34346: {'created_time': 1774786253.254243, 'last_price_update_time': 1774786253.254256, 'auction_closing_time': 1774884698.0}
2026-03-29 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MG34346') HTTP/1.1" 204 0
2026-03-29 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX76007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:54 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for VU12203: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD02824%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for XD02824: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for AA80905: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for TB82163: 2
2026-03-29 12:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-29 12:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 086af578-e4ba-54fb-83d4-b849f1da9f91 with scrape type 2
2026-03-29 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 086af578-e4ba-54fb-83d4-b849f1da9f91 with scrape type 2
2026-03-29 12:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 086af578-e4ba-54fb-83d4-b849f1da9f91, identifier: TB82163
2026-03-29 12:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-29 12:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163
2026-03-29 12:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 086af578-e4ba-54fb-83d4-b849f1da9f91 with identifier: TB82163 to the API
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:03Z',
 'fuel_type': 'diesel',
 'id': '086af578-e4ba-54fb-83d4-b849f1da9f91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB82163',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 277690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Saving data for TB82163: {'auction_closing_time': 1774883643.0, 'created_time': 1774595432.056518, 'last_price_update_time': 1774786254.617506}
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TB82163') HTTP/1.1" 204 0
2026-03-29 12:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for SY92282: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for AX28541: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for DD48612: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for MM08239: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for LC20908: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for KB59261: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for NX76865: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for MD55137: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for SY10793: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for MZ48021: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-29 12:10:54 [auto1.nl] INFO: Scrape type for DS36560: 0
2026-03-29 12:10:54 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-29 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC17693> (referer: https://www.auto1.com/v1/car-details-view/GC17693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX76007> (referer: https://www.auto1.com/v1/car-details-view/EX76007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faae935f-779c-548e-85a3-1275bf146c4b with identifier: GC17693
2026-03-29 12:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faae935f-779c-548e-85a3-1275bf146c4b with scrape type 1
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item faae935f-779c-548e-85a3-1275bf146c4b
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F0f%252F110f8933bf2a1b6bcf79124bf56b67dd%252Fpa%252FGC17693_5be7f8263e920c40f3f7ec7a29bd62c7.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_5be7f8263e920c40f3f7ec7a29bd62c7.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F0f%252F110f8933bf2a1b6bcf79124bf56b67dd%252Fpa%252FGC17693_586c94b7d5c5ddf8cffdfd653a202b0e.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_586c94b7d5c5ddf8cffdfd653a202b0e.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F0f%252F110f8933bf2a1b6bcf79124bf56b67dd%252Fpa%252FGC17693_0acb64f0655ddfaf5d8b0c8a6bd256ec.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_0acb64f0655ddfaf5d8b0c8a6bd256ec.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F0f%252F110f8933bf2a1b6bcf79124bf56b67dd%252Fpa%252FGC17693_31a0cb6f6032ca7c6e191b6f7cecdc7f.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_31a0cb6f6032ca7c6e191b6f7cecdc7f.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F0f%252F110f8933bf2a1b6bcf79124bf56b67dd%252Fpa%252FGC17693_ef44c3f99b0db96a479808bf3898c2c9.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_ef44c3f99b0db96a479808bf3898c2c9.jpg already downloaded
2026-03-29 12:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: faae935f-779c-548e-85a3-1275bf146c4b, identifier: GC17693
2026-03-29 12:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: faae935f-779c-548e-85a3-1275bf146c4b with identifier: GC17693
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: faae935f-779c-548e-85a3-1275bf146c4b with identifier: GC17693
2026-03-29 12:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: faae935f-779c-548e-85a3-1275bf146c4b with identifier: GC17693 to the API
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GC17693>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:48:49Z',
 'fuel_type': 'gas',
 'id': 'faae935f-779c-548e-85a3-1275bf146c4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '87SVL8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC17693',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 166855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_5be7f8263e920c40f3f7ec7a29bd62c7.jpg',
                'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_586c94b7d5c5ddf8cffdfd653a202b0e.jpg',
                'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_0acb64f0655ddfaf5d8b0c8a6bd256ec.jpg',
                'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_31a0cb6f6032ca7c6e191b6f7cecdc7f.jpg',
                'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_ef44c3f99b0db96a479808bf3898c2c9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae935f-779c-548e-85a3-1275bf146c4b/faae935f-779c-548e-85a3-1275bf146c4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_5be7f8263e920c40f3f7ec7a29bd62c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae935f-779c-548e-85a3-1275bf146c4b/faae935f-779c-548e-85a3-1275bf146c4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_586c94b7d5c5ddf8cffdfd653a202b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae935f-779c-548e-85a3-1275bf146c4b/faae935f-779c-548e-85a3-1275bf146c4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_0acb64f0655ddfaf5d8b0c8a6bd256ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae935f-779c-548e-85a3-1275bf146c4b/faae935f-779c-548e-85a3-1275bf146c4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_31a0cb6f6032ca7c6e191b6f7cecdc7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faae935f-779c-548e-85a3-1275bf146c4b/faae935f-779c-548e-85a3-1275bf146c4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/0f/110f8933bf2a1b6bcf79124bf56b67dd/pa/GC17693_ef44c3f99b0db96a479808bf3898c2c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC17693%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [auto1.nl] INFO: Saving data for GC17693: {'created_time': 1774786255.701388, 'last_price_update_time': 1774786255.701397, 'auction_closing_time': 1774885729.0}
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GC17693') HTTP/1.1" 204 0
2026-03-29 12:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bf320d-769b-5f6f-9141-3b49a970dc5c with identifier: EX76007
2026-03-29 12:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bf320d-769b-5f6f-9141-3b49a970dc5c with scrape type 1
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2bf320d-769b-5f6f-9141-3b49a970dc5c
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_73865d6678d4497f13302c52c54948b3.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_73865d6678d4497f13302c52c54948b3.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_3aa8769e1daa9a479acf05dcc256cfd3.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_3aa8769e1daa9a479acf05dcc256cfd3.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_0885132d978ded6ee907d7e046c7e944.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_0885132d978ded6ee907d7e046c7e944.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_96bd84a0b0d135b0abddb7b35afaa407.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_96bd84a0b0d135b0abddb7b35afaa407.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_47c1ecd03c0cda09fe015af7eed45515.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_47c1ecd03c0cda09fe015af7eed45515.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_a9540fe79baebd5bfc64c601705f9c25.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_a9540fe79baebd5bfc64c601705f9c25.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_03292d8d6546090cc6d28ac8c7b9aa72.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_03292d8d6546090cc6d28ac8c7b9aa72.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_716b25aa0b1ebf3817e758cd4e2ea2fd.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_716b25aa0b1ebf3817e758cd4e2ea2fd.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_ecb7881fdb357306c9bad2d39f959bdf.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_ecb7881fdb357306c9bad2d39f959bdf.jpg already downloaded
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fed%252Ffced0f888d450840e655fb8b0640910d%252Fpa%252FEX76007_f28ce11af7fe231aadfe6c02df8ee0bb.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_f28ce11af7fe231aadfe6c02df8ee0bb.jpg already downloaded
2026-03-29 12:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b2bf320d-769b-5f6f-9141-3b49a970dc5c, identifier: EX76007
2026-03-29 12:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b2bf320d-769b-5f6f-9141-3b49a970dc5c with identifier: EX76007
2026-03-29 12:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b2bf320d-769b-5f6f-9141-3b49a970dc5c with identifier: EX76007
2026-03-29 12:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b2bf320d-769b-5f6f-9141-3b49a970dc5c with identifier: EX76007 to the API
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EX76007>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:49:07Z',
 'fuel_type': 'petrol',
 'id': 'b2bf320d-769b-5f6f-9141-3b49a970dc5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TX048S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX76007',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 136240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_73865d6678d4497f13302c52c54948b3.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_3aa8769e1daa9a479acf05dcc256cfd3.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_0885132d978ded6ee907d7e046c7e944.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_96bd84a0b0d135b0abddb7b35afaa407.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_47c1ecd03c0cda09fe015af7eed45515.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_a9540fe79baebd5bfc64c601705f9c25.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_03292d8d6546090cc6d28ac8c7b9aa72.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_716b25aa0b1ebf3817e758cd4e2ea2fd.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_ecb7881fdb357306c9bad2d39f959bdf.jpg',
                'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_f28ce11af7fe231aadfe6c02df8ee0bb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_73865d6678d4497f13302c52c54948b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_3aa8769e1daa9a479acf05dcc256cfd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_0885132d978ded6ee907d7e046c7e944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_96bd84a0b0d135b0abddb7b35afaa407.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_47c1ecd03c0cda09fe015af7eed45515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_a9540fe79baebd5bfc64c601705f9c25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_03292d8d6546090cc6d28ac8c7b9aa72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_716b25aa0b1ebf3817e758cd4e2ea2fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_ecb7881fdb357306c9bad2d39f959bdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bf320d-769b-5f6f-9141-3b49a970dc5c/b2bf320d-769b-5f6f-9141-3b49a970dc5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/ed/fced0f888d450840e655fb8b0640910d/pa/EX76007_f28ce11af7fe231aadfe6c02df8ee0bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Tech Edition',
 'transmission': 'automatic',
 'trim': 'Tech Edition',
 'year': 2018}
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX76007%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Saving data for EX76007: {'created_time': 1774786256.394752, 'last_price_update_time': 1774786256.394761, 'auction_closing_time': 1774885747.0}
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EX76007') HTTP/1.1" 204 0
2026-03-29 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:56 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for RC74760: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for VL07732: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for RX80263: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for DG66253: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for GD99184: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for ZP12059: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for ML63258: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for RA23366: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for NX47084: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for EY85081: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for AC84495: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for FK48987: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for MD18353: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for FP18275: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for BV58634: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for JM47469: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for FL63517: 0
2026-03-29 12:10:56 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-29 12:10:56 [auto1.nl] INFO: Scrape type for BM96536: 0
2026-03-29 12:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:57 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:57 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-29 12:10:57 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-29 12:10:57 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-29 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for WP95967: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for ZL63379: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW60386%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for MW60386: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for CM00428: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for FJ00169: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for GP63449: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for BZ75535: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for PE89486: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for CR31925: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for UR99157: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for ZX00670: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for NP69601: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for SR40415: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for NR15886: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for FL22944: 0
2026-03-29 12:10:58 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-29 12:10:58 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-29 12:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:10:59 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 759 | hits on page: 40
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for CK43593: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for SV78620: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for YZ85937: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for MZ50492: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for UY18740: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for UJ05110: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for XG57923: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for RP15329: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for VM41876: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for FH34143: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for FW39949: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-29 12:10:59 [auto1.nl] INFO: Scrape type for ZP69271: 0
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-29 12:10:59 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-29 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for VD56637: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for BY94157: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for JK88621: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for XD61678: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for YK98733: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for YP25238: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for HD17412: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-29 12:11:00 [auto1.nl] INFO: Scrape type for ES69537: 0
2026-03-29 12:11:00 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-29 12:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:01 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for CR08212: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for GN05115: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for RY75066: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for CJ41969: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for BD37870: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for WK29789: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for EL29526: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for KV87922: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for CP17463: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for SM80467: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for EH64896: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for DB11708: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX51139%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for PX51139: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for AZ42388: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for TW55830: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for BU16200: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for PA43644: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-29 12:11:01 [auto1.nl] INFO: Scrape type for HC58225: 0
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-29 12:11:01 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-29 12:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:02 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for SY53039: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for DN96174: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for BD28084: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for SE84312: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for DZ87358: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for LE78061: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for RC74228: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for MD57319: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for NT33284: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for FR68688: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for AE06801: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for WF02577: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-29 12:11:02 [auto1.nl] INFO: Scrape type for CH10226: 0
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-29 12:11:02 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-29 12:11:03 [auto1.nl] INFO: Scrape type for BM26306: 0
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE94931%27 HTTP/1.1" 200 None
2026-03-29 12:11:03 [auto1.nl] INFO: Scrape type for NE94931: 0
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-29 12:11:03 [auto1.nl] INFO: Scrape type for JS13271: 0
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-29 12:11:03 [auto1.nl] INFO: Scrape type for WG27101: 0
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-29 12:11:03 [auto1.nl] INFO: Scrape type for UB80121: 0
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-29 12:11:03 [auto1.nl] INFO: Scrape type for YE50957: 0
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-29 12:11:03 [auto1.nl] INFO: Scrape type for YH72796: 0
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-29 12:11:03 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-29 12:11:03 [auto1.nl] INFO: Scrape type for GG02103: 0
2026-03-29 12:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:04 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for NB25760: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for GY41852: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for UC91516: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ09106%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for YZ09106: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for GN89359: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for NS14796: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for JX11008: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for VH01672: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for MW03156: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ58386%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for HJ58386: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for VR09113: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for KD36085: 0
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-29 12:11:04 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-29 12:11:04 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-29 12:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:05 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-29 12:11:05 [auto1.nl] INFO: Scrape type for YN37403: 0
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-29 12:11:05 [auto1.nl] INFO: Scrape type for FE21861: 0
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-29 12:11:05 [auto1.nl] INFO: Scrape type for FK39304: 0
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-29 12:11:05 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-29 12:11:05 [auto1.nl] INFO: Scrape type for PY93062: 0
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-29 12:11:05 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for PY55457: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for CL54405: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for AJ38016: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for RJ32742: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for MD45251: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for EJ39658: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for ME20407: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for LG71332: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF49809%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for KF49809: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for AM07460: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for CP77095: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for FC64695: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE91435%27 HTTP/1.1" 200 None
2026-03-29 12:11:06 [auto1.nl] INFO: Scrape type for FE91435: 0
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-29 12:11:06 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-29 12:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:06 [scrapy.extensions.logstats] INFO: Crawled 40 pages (at 40 pages/min), scraped 63 items (at 63 items/min)
2026-03-29 12:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-29 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:07 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-29 12:11:07 [auto1.nl] INFO: Scrape type for TC15988: 0
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-29 12:11:07 [auto1.nl] INFO: Scrape type for WJ55319: 0
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-29 12:11:07 [auto1.nl] INFO: Scrape type for HK90585: 0
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB20368%27 HTTP/1.1" 200 None
2026-03-29 12:11:07 [auto1.nl] INFO: Scrape type for FB20368: 0
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-29 12:11:07 [auto1.nl] INFO: Scrape type for CT01963: 0
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-29 12:11:07 [auto1.nl] INFO: Scrape type for VB13156: 0
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-29 12:11:07 [auto1.nl] INFO: Scrape type for EB00697: 0
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-29 12:11:07 [auto1.nl] INFO: Scrape type for PN82428: 0
2026-03-29 12:11:07 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for YR49127: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for WC97739: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for BP06390: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for VB96147: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for DW43709: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for SM08260: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-29 12:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:08 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-29 12:11:08 [auto1.nl] INFO: Scrape type for AB34968: 0
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-29 12:11:08 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for WE00434: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for SZ87293: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for SY05694: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for GL61326: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for YB51800: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for TP84646: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for UF96545: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for EY58020: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for SG32295: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for TJ11018: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for WY03082: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for EU67961: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for FA26024: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for TU99712: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for BX66014: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for BC50110: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC54517%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for VC54517: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY11680%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for BY11680: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC21131%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for VC21131: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR81542%27 HTTP/1.1" 200 None
2026-03-29 12:11:09 [auto1.nl] INFO: Scrape type for UR81542: 0
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-29 12:11:09 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-29 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR03129%27 HTTP/1.1" 200 None
2026-03-29 12:11:10 [auto1.nl] INFO: Scrape type for BR03129: 0
2026-03-29 12:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:11 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP28763%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for XP28763: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL62659%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for HL62659: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF69205%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for MF69205: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH69810%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for DH69810: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB68589%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for DB68589: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG42782%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for WG42782: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF41961%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for RF41961: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC40672%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for BC40672: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR08670%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for PR08670: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR36555%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for DR36555: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ98625%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for BZ98625: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM68754%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for GM68754: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP71821%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for JP71821: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG04233%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for BG04233: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for AT06250: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW17706%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for JW17706: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU81834%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for GU81834: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC15859%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for BC15859: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR27425%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for XR27425: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME79677%27 HTTP/1.1" 200 None
2026-03-29 12:11:11 [auto1.nl] INFO: Scrape type for ME79677: 0
2026-03-29 12:11:11 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-29 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:12 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT04530%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for PT04530: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS03610%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for PS03610: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18286%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for MD18286: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB08844%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for EB08844: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV55742%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for PV55742: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM51490%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for AM51490: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD35327%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for MD35327: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR09691%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for TR09691: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX19183%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for KX19183: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for JH24547: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL97424%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for HL97424: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB85439%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for AB85439: 0
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-29 12:11:12 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-29 12:11:12 [auto1.nl] INFO: Scrape type for UE65811: 2
2026-03-29 12:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-29 12:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850fcbff-7ba8-5c99-853f-846716cf8cf1 with scrape type 2
2026-03-29 12:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850fcbff-7ba8-5c99-853f-846716cf8cf1 with scrape type 2
2026-03-29 12:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 850fcbff-7ba8-5c99-853f-846716cf8cf1, identifier: UE65811
2026-03-29 12:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-29 12:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-29 12:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811 to the API
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:31Z',
 'fuel_type': 'petrol',
 'id': '850fcbff-7ba8-5c99-853f-846716cf8cf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE65811',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 85958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-16',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-29 12:11:13 [auto1.nl] INFO: Saving data for UE65811: {'auction_closing_time': 1774883131.0, 'created_time': 1774699822.279204, 'last_price_update_time': 1774786273.351653}
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE65811') HTTP/1.1" 204 0
2026-03-29 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:13 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-29 12:11:13 [auto1.nl] INFO: Scrape type for UY86442: 2
2026-03-29 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-29 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a with scrape type 2
2026-03-29 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a with scrape type 2
2026-03-29 12:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d0faeeb-f16f-541d-bea7-50558d26ec2a, identifier: UY86442
2026-03-29 12:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-29 12:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-29 12:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442 to the API
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:07:37Z',
 'fuel_type': 'diesel',
 'id': '3d0faeeb-f16f-541d-bea7-50558d26ec2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY86442',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 288855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-29 12:11:13 [auto1.nl] INFO: Saving data for UY86442: {'auction_closing_time': 1774883257.0, 'created_time': 1774699868.035768, 'last_price_update_time': 1774786273.828671}
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY86442') HTTP/1.1" 204 0
2026-03-29 12:11:13 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-29 12:11:13 [auto1.nl] INFO: Scrape type for WG90560: 2
2026-03-29 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-29 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444c48c3-3381-5989-ab41-910b8b367ec3 with scrape type 2
2026-03-29 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 444c48c3-3381-5989-ab41-910b8b367ec3 with scrape type 2
2026-03-29 12:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 444c48c3-3381-5989-ab41-910b8b367ec3, identifier: WG90560
2026-03-29 12:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-29 12:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-29 12:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560 to the API
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:06Z',
 'fuel_type': 'petrol',
 'id': '444c48c3-3381-5989-ab41-910b8b367ec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG90560',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 94859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2016}
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-29 12:11:14 [auto1.nl] INFO: Saving data for WG90560: {'auction_closing_time': 1774884426.0, 'created_time': 1774699864.982412, 'last_price_update_time': 1774786274.20842}
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG90560') HTTP/1.1" 204 0
2026-03-29 12:11:14 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-29 12:11:14 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-29 12:11:14 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-29 12:11:14 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-29 12:11:14 [auto1.nl] INFO: Scrape type for UR39080: 2
2026-03-29 12:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-29 12:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df17881-0615-5640-83e9-cd5295bb909e with scrape type 2
2026-03-29 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1df17881-0615-5640-83e9-cd5295bb909e with scrape type 2
2026-03-29 12:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1df17881-0615-5640-83e9-cd5295bb909e, identifier: UR39080
2026-03-29 12:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-29 12:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-29 12:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080 to the API
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:52:20Z',
 'fuel_type': 'petrol',
 'id': '1df17881-0615-5640-83e9-cd5295bb909e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR39080',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 135996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-14',
 'seller_name': None,
 'title': 'Volvo V90 2.0 T4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2019}
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-29 12:11:14 [auto1.nl] INFO: Saving data for UR39080: {'auction_closing_time': 1774885940.0, 'created_time': 1774440681.940592, 'last_price_update_time': 1774786274.595928}
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR39080') HTTP/1.1" 204 0
2026-03-29 12:11:14 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-29 12:11:14 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-29 12:11:14 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-29 12:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:15 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:15 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-29 12:11:15 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-29 12:11:15 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-29 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-29 12:11:15 [auto1.nl] INFO: Scrape type for PH88105: 2
2026-03-29 12:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-29 12:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6b085d-7443-5b82-9770-1cfd82694c34 with scrape type 2
2026-03-29 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6b085d-7443-5b82-9770-1cfd82694c34 with scrape type 2
2026-03-29 12:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0f6b085d-7443-5b82-9770-1cfd82694c34, identifier: PH88105
2026-03-29 12:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-29 12:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-29 12:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105 to the API
2026-03-29 12:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:29:39Z',
 'fuel_type': 'petrol',
 'id': '0f6b085d-7443-5b82-9770-1cfd82694c34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH88105',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 204758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2013}
2026-03-29 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-29 12:11:15 [auto1.nl] INFO: Saving data for PH88105: {'auction_closing_time': 1774884579.0, 'created_time': 1774699859.368363, 'last_price_update_time': 1774786275.895053}
2026-03-29 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PH88105') HTTP/1.1" 204 0
2026-03-29 12:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:16 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-29 12:11:16 [auto1.nl] INFO: Scrape type for UF12505: 2
2026-03-29 12:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-29 12:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4984b984-35a6-57e2-bee5-74b747984935 with scrape type 2
2026-03-29 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4984b984-35a6-57e2-bee5-74b747984935 with scrape type 2
2026-03-29 12:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4984b984-35a6-57e2-bee5-74b747984935, identifier: UF12505
2026-03-29 12:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-29 12:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-29 12:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505 to the API
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:50:59Z',
 'fuel_type': 'petrol',
 'id': '4984b984-35a6-57e2-bee5-74b747984935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF12505',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 202222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Feline',
 'transmission': 'automatic',
 'trim': 'Feline',
 'year': 2015}
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-29 12:11:16 [auto1.nl] INFO: Saving data for UF12505: {'auction_closing_time': 1774885859.0, 'created_time': 1774699864.620212, 'last_price_update_time': 1774786276.386672}
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF12505') HTTP/1.1" 204 0
2026-03-29 12:11:16 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-29 12:11:16 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-29 12:11:16 [auto1.nl] INFO: Scrape type for XK28167: 2
2026-03-29 12:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-29 12:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0e3456-123f-53b7-b2e4-203eec5b124b with scrape type 2
2026-03-29 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0e3456-123f-53b7-b2e4-203eec5b124b with scrape type 2
2026-03-29 12:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ed0e3456-123f-53b7-b2e4-203eec5b124b, identifier: XK28167
2026-03-29 12:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-29 12:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-29 12:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167 to the API
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'ed0e3456-123f-53b7-b2e4-203eec5b124b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK28167',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S80',
 'odometer': 322705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-28',
 'seller_name': None,
 'title': 'Volvo S80 2.5 TF Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-29 12:11:16 [auto1.nl] INFO: Saving data for XK28167: {'auction_closing_time': 1774885690.0, 'created_time': 1774699858.628594, 'last_price_update_time': 1774786276.772579}
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XK28167') HTTP/1.1" 204 0
2026-03-29 12:11:16 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-29 12:11:16 [auto1.nl] INFO: Scrape type for JC30911: 2
2026-03-29 12:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-29 12:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295ae144-6ea5-53ed-81d6-2d72c0a23940 with scrape type 2
2026-03-29 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295ae144-6ea5-53ed-81d6-2d72c0a23940 with scrape type 2
2026-03-29 12:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 295ae144-6ea5-53ed-81d6-2d72c0a23940, identifier: JC30911
2026-03-29 12:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-29 12:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-29 12:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911 to the API
2026-03-29 12:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:48:56Z',
 'fuel_type': 'petrol',
 'id': '295ae144-6ea5-53ed-81d6-2d72c0a23940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC30911',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 117943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-15',
 'seller_name': None,
 'title': 'Peugeot 206 1.6 CC',
 'transmission': 'automatic',
 'trim': 'CC',
 'year': 2003}
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-29 12:11:17 [auto1.nl] INFO: Saving data for JC30911: {'auction_closing_time': 1774885736.0, 'created_time': 1774699862.606207, 'last_price_update_time': 1774786277.145463}
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC30911') HTTP/1.1" 204 0
2026-03-29 12:11:17 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-29 12:11:17 [auto1.nl] INFO: Scrape type for AX92237: 2
2026-03-29 12:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-29 12:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with scrape type 2
2026-03-29 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with scrape type 2
2026-03-29 12:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047, identifier: AX92237
2026-03-29 12:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-29 12:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-29 12:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237 to the API
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:55:25Z',
 'fuel_type': 'petrol',
 'id': '9fdb8bb0-d0e2-56db-8ee1-34905a27a047',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX92237',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 157242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-05',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Edition 40 Jahre',
 'transmission': 'manual',
 'trim': 'Edition 40 Jahre',
 'year': 2012}
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-29 12:11:17 [auto1.nl] INFO: Saving data for AX92237: {'auction_closing_time': 1774886125.0, 'created_time': 1774699858.979291, 'last_price_update_time': 1774786277.529622}
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX92237') HTTP/1.1" 204 0
2026-03-29 12:11:17 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-29 12:11:17 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-29 12:11:17 [auto1.nl] INFO: Scrape type for UB73502: 2
2026-03-29 12:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-29 12:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64f9130-0f9b-5b88-bb20-60061a5dd155 with scrape type 2
2026-03-29 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64f9130-0f9b-5b88-bb20-60061a5dd155 with scrape type 2
2026-03-29 12:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e64f9130-0f9b-5b88-bb20-60061a5dd155, identifier: UB73502
2026-03-29 12:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-29 12:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-29 12:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502 to the API
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:10:54Z',
 'fuel_type': 'hybrid',
 'id': 'e64f9130-0f9b-5b88-bb20-60061a5dd155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB73502',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 52410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-29 12:11:17 [auto1.nl] INFO: Saving data for UB73502: {'auction_closing_time': 1774883454.0, 'created_time': 1774465873.211142, 'last_price_update_time': 1774786277.88626}
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB73502') HTTP/1.1" 204 0
2026-03-29 12:11:17 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-29 12:11:17 [auto1.nl] INFO: Scrape type for TP02076: 2
2026-03-29 12:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-29 12:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5243dc9-af76-596e-895a-5a4b86723b1a with scrape type 2
2026-03-29 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5243dc9-af76-596e-895a-5a4b86723b1a with scrape type 2
2026-03-29 12:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5243dc9-af76-596e-895a-5a4b86723b1a, identifier: TP02076
2026-03-29 12:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-29 12:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-29 12:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076 to the API
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:59:19Z',
 'fuel_type': 'diesel',
 'id': 'e5243dc9-af76-596e-895a-5a4b86723b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP02076',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 279912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-19',
 'seller_name': None,
 'title': 'Ford S-Max 1.8 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-29 12:11:18 [auto1.nl] INFO: Saving data for TP02076: {'auction_closing_time': 1774886359.0, 'created_time': 1774699827.069048, 'last_price_update_time': 1774786278.256411}
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP02076') HTTP/1.1" 204 0
2026-03-29 12:11:18 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-29 12:11:18 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-29 12:11:18 [auto1.nl] INFO: Scrape type for BV07887: 2
2026-03-29 12:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-29 12:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33db28ef-ee4f-5660-808f-2816e530db27 with scrape type 2
2026-03-29 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33db28ef-ee4f-5660-808f-2816e530db27 with scrape type 2
2026-03-29 12:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 33db28ef-ee4f-5660-808f-2816e530db27, identifier: BV07887
2026-03-29 12:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-29 12:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-29 12:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887 to the API
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:15:19Z',
 'fuel_type': 'diesel',
 'id': '33db28ef-ee4f-5660-808f-2816e530db27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV07887',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 282108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-11',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 HDi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2012}
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-29 12:11:18 [auto1.nl] INFO: Saving data for BV07887: {'auction_closing_time': 1774883719.0, 'created_time': 1774033986.549565, 'last_price_update_time': 1774786278.634187}
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV07887') HTTP/1.1" 204 0
2026-03-29 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:18 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-29 12:11:18 [auto1.nl] INFO: Scrape type for ZE09391: 2
2026-03-29 12:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-29 12:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with scrape type 2
2026-03-29 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with scrape type 2
2026-03-29 12:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2427ff2f-a130-5e1b-8fbd-39683ea48d83, identifier: ZE09391
2026-03-29 12:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-29 12:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-29 12:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391 to the API
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:49:26Z',
 'fuel_type': 'petrol',
 'id': '2427ff2f-a130-5e1b-8fbd-39683ea48d83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE09391',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 157731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-29 12:11:19 [auto1.nl] INFO: Saving data for ZE09391: {'auction_closing_time': 1774885766.0, 'created_time': 1774699876.542312, 'last_price_update_time': 1774786279.011216}
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE09391') HTTP/1.1" 204 0
2026-03-29 12:11:19 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-29 12:11:19 [auto1.nl] INFO: Scrape type for ER86910: 2
2026-03-29 12:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-29 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58905a35-329b-5616-9c3b-d114610ed4c2 with scrape type 2
2026-03-29 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58905a35-329b-5616-9c3b-d114610ed4c2 with scrape type 2
2026-03-29 12:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58905a35-329b-5616-9c3b-d114610ed4c2, identifier: ER86910
2026-03-29 12:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-29 12:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-29 12:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910 to the API
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:04Z',
 'fuel_type': 'petrol',
 'id': '58905a35-329b-5616-9c3b-d114610ed4c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER86910',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 129299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-22',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.2 Turbo Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-29 12:11:19 [auto1.nl] INFO: Saving data for ER86910: {'auction_closing_time': 1774884964.0, 'created_time': 1774699852.624793, 'last_price_update_time': 1774786279.481256}
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ER86910') HTTP/1.1" 204 0
2026-03-29 12:11:19 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 759 | hits on page: 40
2026-03-29 12:11:19 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-29 12:11:19 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-29 12:11:19 [auto1.nl] INFO: Scrape type for DR23359: 2
2026-03-29 12:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-29 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc639650-0ba1-56f0-a8f7-8b35e619087c with scrape type 2
2026-03-29 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc639650-0ba1-56f0-a8f7-8b35e619087c with scrape type 2
2026-03-29 12:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dc639650-0ba1-56f0-a8f7-8b35e619087c, identifier: DR23359
2026-03-29 12:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-29 12:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-29 12:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359 to the API
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'petrol',
 'id': 'dc639650-0ba1-56f0-a8f7-8b35e619087c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR23359',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 179090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-02',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2012}
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-29 12:11:19 [auto1.nl] INFO: Saving data for DR23359: {'auction_closing_time': 1774884913.0, 'created_time': 1774034001.769749, 'last_price_update_time': 1774786279.850638}
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR23359') HTTP/1.1" 204 0
2026-03-29 12:11:19 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-29 12:11:19 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-29 12:11:19 [auto1.nl] INFO: Scrape type for PA65227: 2
2026-03-29 12:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-29 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07038d-6030-54c4-8294-d15ea6a252ea with scrape type 2
2026-03-29 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e07038d-6030-54c4-8294-d15ea6a252ea with scrape type 2
2026-03-29 12:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e07038d-6030-54c4-8294-d15ea6a252ea, identifier: PA65227
2026-03-29 12:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:19 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-29 12:11:19 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-29 12:11:19 [auto1.nl] INFO: Scrape type for MH16372: 2
2026-03-29 12:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-29 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with scrape type 2
2026-03-29 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with scrape type 2
2026-03-29 12:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210, identifier: MH16372
2026-03-29 12:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 12:11:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-29 12:11:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-29 12:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227 to the API
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:11:31Z',
 'fuel_type': 'electro',
 'id': '1e07038d-6030-54c4-8294-d15ea6a252ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA65227',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'eVito',
 'odometer': 82128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-06',
 'seller_name': None,
 'title': 'Mercedes-Benz eVito electric drive 85 kW lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2024}
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-29 12:11:20 [auto1.nl] INFO: Saving data for PA65227: {'auction_closing_time': 1774883491.0, 'created_time': 1774699849.036224, 'last_price_update_time': 1774786280.609563}
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA65227') HTTP/1.1" 204 0
2026-03-29 12:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-29 12:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-29 12:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372 to the API
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:44:37Z',
 'fuel_type': 'petrol',
 'id': '20dadf3f-b2a1-5a7d-ad79-3960c0c71210',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH16372',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 271085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-29 12:11:20 [auto1.nl] INFO: Saving data for MH16372: {'auction_closing_time': 1774885477.0, 'created_time': 1774552324.378703, 'last_price_update_time': 1774786280.869288}
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MH16372') HTTP/1.1" 204 0
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG71940%27 HTTP/1.1" 200 None
2026-03-29 12:11:20 [auto1.nl] INFO: Scrape type for HG71940: 0
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV57262%27 HTTP/1.1" 200 None
2026-03-29 12:11:20 [auto1.nl] INFO: Scrape type for MV57262: 0
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS29188%27 HTTP/1.1" 200 None
2026-03-29 12:11:20 [auto1.nl] INFO: Scrape type for VS29188: 0
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ45478%27 HTTP/1.1" 200 None
2026-03-29 12:11:20 [auto1.nl] INFO: Scrape type for ZZ45478: 0
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW57039%27 HTTP/1.1" 200 None
2026-03-29 12:11:20 [auto1.nl] INFO: Scrape type for RW57039: 0
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM15601%27 HTTP/1.1" 200 None
2026-03-29 12:11:20 [auto1.nl] INFO: Scrape type for HM15601: 0
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-29 12:11:20 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP36316%27 HTTP/1.1" 200 None
2026-03-29 12:11:21 [auto1.nl] INFO: Scrape type for GP36316: 0
2026-03-29 12:11:21 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-29 12:11:21 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-29 12:11:21 [auto1.nl] INFO: Scrape type for UE83954: 2
2026-03-29 12:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-29 12:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with scrape type 2
2026-03-29 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with scrape type 2
2026-03-29 12:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355, identifier: UE83954
2026-03-29 12:11:21 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-29 12:11:21 [auto1.nl] INFO: Scrape type for ME24209: 2
2026-03-29 12:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-29 12:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d with scrape type 2
2026-03-29 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d with scrape type 2
2026-03-29 12:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8c8001cd-8a76-5c14-8199-6303f5c9df6d, identifier: ME24209
2026-03-29 12:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-29 12:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-29 12:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954 to the API
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 470,
 'expiration_date': '2026-03-30T15:05:52Z',
 'fuel_type': 'electro',
 'id': '82d1f1ee-93e1-5933-a02b-8dad2d0d8355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE83954',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model X',
 'odometer': 299370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Tesla Model X 100D Dual',
 'transmission': 'automatic',
 'trim': 'Dual',
 'year': 2018}
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-29 12:11:21 [auto1.nl] INFO: Saving data for UE83954: {'auction_closing_time': 1774883152.0, 'created_time': 1774699873.029483, 'last_price_update_time': 1774786281.501555}
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE83954') HTTP/1.1" 204 0
2026-03-29 12:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-29 12:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-29 12:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209 to the API
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:19:03Z',
 'fuel_type': 'petrol',
 'id': '8c8001cd-8a76-5c14-8199-6303f5c9df6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME24209',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 370484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-01',
 'seller_name': None,
 'title': 'Volvo XC90 2.5 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-29 12:11:21 [auto1.nl] INFO: Saving data for ME24209: {'auction_closing_time': 1774883943.0, 'created_time': 1774699851.886586, 'last_price_update_time': 1774786281.846443}
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME24209') HTTP/1.1" 204 0
2026-03-29 12:11:21 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-29 12:11:21 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-29 12:11:21 [auto1.nl] INFO: Scrape type for XG85677: 2
2026-03-29 12:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-29 12:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74da6829-81b5-54dc-a369-acff1d44363f with scrape type 2
2026-03-29 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74da6829-81b5-54dc-a369-acff1d44363f with scrape type 2
2026-03-29 12:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74da6829-81b5-54dc-a369-acff1d44363f, identifier: XG85677
2026-03-29 12:11:21 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-29 12:11:22 [auto1.nl] INFO: Scrape type for PU27111: 0
2026-03-29 12:11:22 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-29 12:11:22 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-29 12:11:22 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-29 12:11:22 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-29 12:11:22 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-29 12:11:22 [auto1.nl] INFO: Scrape type for EH33258: 2
2026-03-29 12:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-29 12:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d91734-2904-5060-9ee7-bf5d724f6b35 with scrape type 2
2026-03-29 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6d91734-2904-5060-9ee7-bf5d724f6b35 with scrape type 2
2026-03-29 12:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6d91734-2904-5060-9ee7-bf5d724f6b35, identifier: EH33258
2026-03-29 12:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-29 12:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-29 12:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677 to the API
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:54:52Z',
 'fuel_type': 'hybrid',
 'id': '74da6829-81b5-54dc-a369-acff1d44363f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG85677',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 185756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-29 12:11:22 [auto1.nl] INFO: Saving data for XG85677: {'auction_closing_time': 1774886092.0, 'created_time': 1774699872.633596, 'last_price_update_time': 1774786282.375245}
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XG85677') HTTP/1.1" 204 0
2026-03-29 12:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-29 12:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-29 12:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258 to the API
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:07:10Z',
 'fuel_type': 'petrol',
 'id': 'd6d91734-2904-5060-9ee7-bf5d724f6b35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH33258',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 332576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-03',
 'seller_name': None,
 'title': 'Volvo XC90 3.2 Sport Geartronic',
 'transmission': 'automatic',
 'trim': 'Sport Geartronic',
 'year': 2008}
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-29 12:11:22 [auto1.nl] INFO: Saving data for EH33258: {'auction_closing_time': 1774883230.0, 'created_time': 1774699864.23693, 'last_price_update_time': 1774786282.665268}
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH33258') HTTP/1.1" 204 0
2026-03-29 12:11:22 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-29 12:11:22 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-29 12:11:22 [auto1.nl] INFO: Scrape type for SX97177: 2
2026-03-29 12:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-29 12:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with scrape type 2
2026-03-29 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with scrape type 2
2026-03-29 12:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d, identifier: SX97177
2026-03-29 12:11:22 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-29 12:11:22 [auto1.nl] INFO: Scrape type for SE67800: 2
2026-03-29 12:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-29 12:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88977c0-4d35-544c-b133-257b8d5a731b with scrape type 2
2026-03-29 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d88977c0-4d35-544c-b133-257b8d5a731b with scrape type 2
2026-03-29 12:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d88977c0-4d35-544c-b133-257b8d5a731b, identifier: SE67800
2026-03-29 12:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-29 12:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-29 12:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177 to the API
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:44:13Z',
 'fuel_type': 'diesel',
 'id': 'dd9da3f8-60c5-53cb-b2fd-c79459b82f5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX97177',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 338851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-06',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-29 12:11:23 [auto1.nl] INFO: Saving data for SX97177: {'auction_closing_time': 1774885453.0, 'created_time': 1774699876.173328, 'last_price_update_time': 1774786283.369311}
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX97177') HTTP/1.1" 204 0
2026-03-29 12:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-29 12:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-29 12:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800 to the API
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:32Z',
 'fuel_type': 'petrol',
 'id': 'd88977c0-4d35-544c-b133-257b8d5a731b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE67800',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 239178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2006}
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-29 12:11:23 [auto1.nl] INFO: Saving data for SE67800: {'auction_closing_time': 1774885832.0, 'created_time': 1774699851.500948, 'last_price_update_time': 1774786283.712865}
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE67800') HTTP/1.1" 204 0
2026-03-29 12:11:23 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-29 12:11:23 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-29 12:11:23 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-29 12:11:23 [auto1.nl] INFO: Scrape type for PF57895: 2
2026-03-29 12:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-29 12:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item facf7e4a-cc13-5a68-a60c-79ce99195938 with scrape type 2
2026-03-29 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item facf7e4a-cc13-5a68-a60c-79ce99195938 with scrape type 2
2026-03-29 12:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: facf7e4a-cc13-5a68-a60c-79ce99195938, identifier: PF57895
2026-03-29 12:11:23 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-29 12:11:23 [auto1.nl] INFO: Scrape type for TN45594: 2
2026-03-29 12:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-29 12:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c436dec9-a348-5375-b382-724c7843d728 with scrape type 2
2026-03-29 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c436dec9-a348-5375-b382-724c7843d728 with scrape type 2
2026-03-29 12:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c436dec9-a348-5375-b382-724c7843d728, identifier: TN45594
2026-03-29 12:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-29 12:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-29 12:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895 to the API
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:27Z',
 'fuel_type': 'petrol',
 'id': 'facf7e4a-cc13-5a68-a60c-79ce99195938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF57895',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 104736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-29 12:11:24 [auto1.nl] INFO: Saving data for PF57895: {'auction_closing_time': 1774884267.0, 'created_time': 1774699866.732402, 'last_price_update_time': 1774786284.214971}
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PF57895') HTTP/1.1" 204 0
2026-03-29 12:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-29 12:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-29 12:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594 to the API
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:18:36Z',
 'fuel_type': 'diesel',
 'id': 'c436dec9-a348-5375-b382-724c7843d728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN45594',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 222353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-04',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-29 12:11:24 [auto1.nl] INFO: Saving data for TN45594: {'auction_closing_time': 1774883916.0, 'created_time': 1774699870.809288, 'last_price_update_time': 1774786284.497183}
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN45594') HTTP/1.1" 204 0
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-29 12:11:24 [auto1.nl] INFO: Scrape type for HV92208: 2
2026-03-29 12:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-29 12:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with scrape type 2
2026-03-29 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with scrape type 2
2026-03-29 12:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5, identifier: HV92208
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK48702%27 HTTP/1.1" 200 None
2026-03-29 12:11:24 [auto1.nl] INFO: Scrape type for HK48702: 0
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX89333%27 HTTP/1.1" 200 None
2026-03-29 12:11:24 [auto1.nl] INFO: Scrape type for PX89333: 0
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-29 12:11:24 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-29 12:11:24 [auto1.nl] INFO: Scrape type for JM32164: 2
2026-03-29 12:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-29 12:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with scrape type 2
2026-03-29 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with scrape type 2
2026-03-29 12:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe, identifier: JM32164
2026-03-29 12:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-29 12:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-29 12:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208 to the API
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:53:05Z',
 'fuel_type': 'petrol',
 'id': 'a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV92208',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 46843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-08',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2024}
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-29 12:11:25 [auto1.nl] INFO: Saving data for HV92208: {'auction_closing_time': 1774885985.0, 'created_time': 1774699849.651587, 'last_price_update_time': 1774786285.027143}
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HV92208') HTTP/1.1" 204 0
2026-03-29 12:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-29 12:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-29 12:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164 to the API
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'diesel',
 'id': '1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM32164',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 178774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-17',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2014}
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-29 12:11:25 [auto1.nl] INFO: Saving data for JM32164: {'auction_closing_time': 1774885963.0, 'created_time': 1774699851.147475, 'last_price_update_time': 1774786285.414758}
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM32164') HTTP/1.1" 204 0
2026-03-29 12:11:25 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-29 12:11:25 [auto1.nl] INFO: Scrape type for WY33906: 2
2026-03-29 12:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-29 12:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2313a936-a8e6-5709-83cc-5140e234e2f4 with scrape type 2
2026-03-29 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2313a936-a8e6-5709-83cc-5140e234e2f4 with scrape type 2
2026-03-29 12:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2313a936-a8e6-5709-83cc-5140e234e2f4, identifier: WY33906
2026-03-29 12:11:25 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-29 12:11:25 [auto1.nl] INFO: Scrape type for HM06318: 2
2026-03-29 12:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-29 12:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ccd898-0669-55ff-92da-5fac068ba1c4 with scrape type 2
2026-03-29 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52ccd898-0669-55ff-92da-5fac068ba1c4 with scrape type 2
2026-03-29 12:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 52ccd898-0669-55ff-92da-5fac068ba1c4, identifier: HM06318
2026-03-29 12:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-29 12:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-29 12:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906 to the API
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'hybrid',
 'id': '2313a936-a8e6-5709-83cc-5140e234e2f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY33906',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 233495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-19',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line',
 'transmission': 'automatic',
 'trim': 'N Line',
 'year': 2021}
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-29 12:11:25 [auto1.nl] INFO: Saving data for WY33906: {'auction_closing_time': 1774882995.0, 'created_time': 1774699868.391582, 'last_price_update_time': 1774786285.927283}
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY33906') HTTP/1.1" 204 0
2026-03-29 12:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-29 12:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-29 12:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318 to the API
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 514,
 'expiration_date': '2026-03-30T15:53:17Z',
 'fuel_type': 'electro',
 'id': '52ccd898-0669-55ff-92da-5fac068ba1c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM06318',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 112245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seller_name': None,
 'title': 'Tesla Model Y Max Range Dual AWD AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2022}
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-29 12:11:26 [auto1.nl] INFO: Saving data for HM06318: {'auction_closing_time': 1774885997.0, 'created_time': 1774699881.914954, 'last_price_update_time': 1774786286.18511}
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM06318') HTTP/1.1" 204 0
2026-03-29 12:11:26 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-29 12:11:26 [auto1.nl] INFO: Scrape type for WN49119: 2
2026-03-29 12:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-29 12:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a466afae-1dfc-5d72-990e-54c8afcbbf86 with scrape type 2
2026-03-29 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a466afae-1dfc-5d72-990e-54c8afcbbf86 with scrape type 2
2026-03-29 12:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a466afae-1dfc-5d72-990e-54c8afcbbf86, identifier: WN49119
2026-03-29 12:11:26 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-29 12:11:26 [auto1.nl] INFO: Scrape type for KH60865: 2
2026-03-29 12:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-29 12:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with scrape type 2
2026-03-29 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with scrape type 2
2026-03-29 12:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 35cd0ea0-88b0-5bb6-bb50-23592071ea99, identifier: KH60865
2026-03-29 12:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-29 12:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-29 12:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119 to the API
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:27:51Z',
 'fuel_type': 'hybrid',
 'id': 'a466afae-1dfc-5d72-990e-54c8afcbbf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN49119',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 187001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-29 12:11:26 [auto1.nl] INFO: Saving data for WN49119: {'auction_closing_time': 1774884471.0, 'created_time': 1774699848.527156, 'last_price_update_time': 1774786286.664004}
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN49119') HTTP/1.1" 204 0
2026-03-29 12:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-29 12:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-29 12:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865 to the API
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:38Z',
 'fuel_type': 'diesel',
 'id': '35cd0ea0-88b0-5bb6-bb50-23592071ea99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH60865',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 319669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-02',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D4 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-29 12:11:26 [auto1.nl] INFO: Saving data for KH60865: {'auction_closing_time': 1774884938.0, 'created_time': 1774699881.561968, 'last_price_update_time': 1774786286.959689}
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KH60865') HTTP/1.1" 204 0
2026-03-29 12:11:26 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-29 12:11:26 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-29 12:11:26 [auto1.nl] INFO: Scrape type for XM87869: 2
2026-03-29 12:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-29 12:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d54751-09fa-59ea-8510-0959d073654d with scrape type 2
2026-03-29 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d54751-09fa-59ea-8510-0959d073654d with scrape type 2
2026-03-29 12:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5d54751-09fa-59ea-8510-0959d073654d, identifier: XM87869
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS42620%27 HTTP/1.1" 200 None
2026-03-29 12:11:27 [auto1.nl] INFO: Scrape type for GS42620: 0
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ91466%27 HTTP/1.1" 200 None
2026-03-29 12:11:27 [auto1.nl] INFO: Scrape type for YJ91466: 0
2026-03-29 12:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-29 12:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-29 12:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869 to the API
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:47:16Z',
 'fuel_type': 'petrol',
 'id': 'e5d54751-09fa-59ea-8510-0959d073654d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM87869',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 250938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-19',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-29 12:11:27 [auto1.nl] INFO: Saving data for XM87869: {'auction_closing_time': 1774885636.0, 'created_time': 1774699839.09976, 'last_price_update_time': 1774786287.380184}
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XM87869') HTTP/1.1" 204 0
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-29 12:11:27 [auto1.nl] INFO: Scrape type for FB82909: 2
2026-03-29 12:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-29 12:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4342915f-5ba8-550a-84d2-cde7b5252675 with scrape type 2
2026-03-29 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4342915f-5ba8-550a-84d2-cde7b5252675 with scrape type 2
2026-03-29 12:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4342915f-5ba8-550a-84d2-cde7b5252675, identifier: FB82909
2026-03-29 12:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-29 12:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-29 12:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909 to the API
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:10:31Z',
 'fuel_type': 'petrol',
 'id': '4342915f-5ba8-550a-84d2-cde7b5252675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB82909',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 53781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-18',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop Star',
 'transmission': 'automatic',
 'trim': 'Pop Star',
 'year': 2018}
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-29 12:11:27 [auto1.nl] INFO: Saving data for FB82909: {'auction_closing_time': 1774883431.0, 'created_time': 1774699846.124418, 'last_price_update_time': 1774786287.77803}
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB82909') HTTP/1.1" 204 0
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-29 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:27 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 759 | hits on page: 39
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-29 12:11:27 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-29 12:11:27 [auto1.nl] INFO: Scrape type for YX65431: 2
2026-03-29 12:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-29 12:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560dad57-a578-594f-b026-61aeb8198025 with scrape type 2
2026-03-29 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 560dad57-a578-594f-b026-61aeb8198025 with scrape type 2
2026-03-29 12:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 560dad57-a578-594f-b026-61aeb8198025, identifier: YX65431
2026-03-29 12:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-29 12:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-29 12:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431 to the API
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:10Z',
 'fuel_type': 'petrol',
 'id': '560dad57-a578-594f-b026-61aeb8198025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX65431',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 275185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-23',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-29 12:11:28 [auto1.nl] INFO: Saving data for YX65431: {'auction_closing_time': 1774884790.0, 'created_time': 1774699834.962894, 'last_price_update_time': 1774786288.263753}
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YX65431') HTTP/1.1" 204 0
2026-03-29 12:11:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:11:28 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-29 12:11:28 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-29 12:11:28 [auto1.nl] INFO: Scrape type for MZ74119: 2
2026-03-29 12:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-29 12:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c with scrape type 2
2026-03-29 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c with scrape type 2
2026-03-29 12:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ebba39ab-1cd4-54bf-94e1-c098c9f4099c, identifier: MZ74119
2026-03-29 12:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-29 12:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-29 12:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119 to the API
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:56:06Z',
 'fuel_type': 'diesel',
 'id': 'ebba39ab-1cd4-54bf-94e1-c098c9f4099c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ74119',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 256902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-05',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-29 12:11:28 [auto1.nl] INFO: Saving data for MZ74119: {'auction_closing_time': 1774886166.0, 'created_time': 1774699840.822941, 'last_price_update_time': 1774786288.712147}
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ74119') HTTP/1.1" 204 0
2026-03-29 12:11:28 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-29 12:11:28 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-29 12:11:28 [auto1.nl] INFO: Scrape type for GW58352: 2
2026-03-29 12:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-29 12:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with scrape type 2
2026-03-29 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with scrape type 2
2026-03-29 12:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c, identifier: GW58352
2026-03-29 12:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-29 12:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-29 12:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352 to the API
2026-03-29 12:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:26:12Z',
 'fuel_type': 'petrol',
 'id': '8092a7e4-d46c-56b9-adfc-9f19a63dd41c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW58352',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 106180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-29 12:11:29 [auto1.nl] INFO: Saving data for GW58352: {'auction_closing_time': 1774884372.0, 'created_time': 1774699832.219375, 'last_price_update_time': 1774786289.125874}
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW58352') HTTP/1.1" 204 0
2026-03-29 12:11:29 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-29 12:11:29 [auto1.nl] INFO: Scrape type for JB09830: 2
2026-03-29 12:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-29 12:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with scrape type 2
2026-03-29 12:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with scrape type 2
2026-03-29 12:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1edba11a-c0b2-5440-bb87-ac751f84ffa8, identifier: JB09830
2026-03-29 12:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-29 12:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-29 12:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830 to the API
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'electro',
 'id': '1edba11a-c0b2-5440-bb87-ac751f84ffa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB09830',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 156843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2021}
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-29 12:11:29 [auto1.nl] INFO: Saving data for JB09830: {'auction_closing_time': 1774883761.0, 'created_time': 1773904222.46797, 'last_price_update_time': 1774786289.518946}
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB09830') HTTP/1.1" 204 0
2026-03-29 12:11:29 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-29 12:11:29 [auto1.nl] INFO: Scrape type for CY78777: 2
2026-03-29 12:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-29 12:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with scrape type 2
2026-03-29 12:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with scrape type 2
2026-03-29 12:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e205ab4-26b7-517e-a4bf-5cd859a04f47, identifier: CY78777
2026-03-29 12:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-29 12:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-29 12:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777 to the API
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:44:52Z',
 'fuel_type': 'petrol',
 'id': '0e205ab4-26b7-517e-a4bf-5cd859a04f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY78777',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 156543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Exklusiv',
 'transmission': 'manual',
 'trim': 'Exklusiv',
 'year': 2015}
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-29 12:11:29 [auto1.nl] INFO: Saving data for CY78777: {'auction_closing_time': 1774885492.0, 'created_time': 1774699833.047819, 'last_price_update_time': 1774786289.879281}
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY78777') HTTP/1.1" 204 0
2026-03-29 12:11:29 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-29 12:11:29 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-29 12:11:29 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-29 12:11:29 [auto1.nl] INFO: Scrape type for DL13637: 2
2026-03-29 12:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-29 12:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6d8bb91-00f7-5269-8245-353e68c0a4b7 with scrape type 2
2026-03-29 12:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6d8bb91-00f7-5269-8245-353e68c0a4b7 with scrape type 2
2026-03-29 12:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f6d8bb91-00f7-5269-8245-353e68c0a4b7, identifier: DL13637
2026-03-29 12:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-29 12:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-29 12:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637 to the API
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:17:04Z',
 'fuel_type': 'petrol',
 'id': 'f6d8bb91-00f7-5269-8245-353e68c0a4b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL13637',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 300062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-28',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-29 12:11:30 [auto1.nl] INFO: Saving data for DL13637: {'auction_closing_time': 1774883824.0, 'created_time': 1774699833.720753, 'last_price_update_time': 1774786290.249774}
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DL13637') HTTP/1.1" 204 0
2026-03-29 12:11:30 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-29 12:11:30 [auto1.nl] INFO: Scrape type for CD19489: 2
2026-03-29 12:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-29 12:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with scrape type 2
2026-03-29 12:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with scrape type 2
2026-03-29 12:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a, identifier: CD19489
2026-03-29 12:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-29 12:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-29 12:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489 to the API
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-30T15:32:01Z',
 'fuel_type': 'hybrid',
 'id': 'b98dca43-a229-54a0-a3f5-ed30d4ca8d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD19489',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 140826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-02',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2014}
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-29 12:11:30 [auto1.nl] INFO: Saving data for CD19489: {'auction_closing_time': 1774884721.0, 'created_time': 1773429050.698539, 'last_price_update_time': 1774786290.631664}
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CD19489') HTTP/1.1" 204 0
2026-03-29 12:11:30 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-29 12:11:30 [auto1.nl] INFO: Scrape type for RY80321: 2
2026-03-29 12:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-29 12:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53762ab1-1094-5a33-9bbb-cfe686d3a64a with scrape type 2
2026-03-29 12:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53762ab1-1094-5a33-9bbb-cfe686d3a64a with scrape type 2
2026-03-29 12:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 53762ab1-1094-5a33-9bbb-cfe686d3a64a, identifier: RY80321
2026-03-29 12:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-29 12:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-29 12:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321 to the API
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:05:41Z',
 'fuel_type': 'diesel',
 'id': '53762ab1-1094-5a33-9bbb-cfe686d3a64a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY80321',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 289995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2014}
2026-03-29 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-29 12:11:31 [auto1.nl] INFO: Saving data for RY80321: {'auction_closing_time': 1774883141.0, 'created_time': 1774699835.913988, 'last_price_update_time': 1774786291.015789}
2026-03-29 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY80321') HTTP/1.1" 204 0
2026-03-29 12:11:31 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-29 12:11:31 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-29 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-29 12:11:31 [auto1.nl] INFO: Scrape type for KC04488: 2
2026-03-29 12:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-29 12:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af6988aa-27fb-518d-a792-2f321a99c71f with scrape type 2
2026-03-29 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af6988aa-27fb-518d-a792-2f321a99c71f with scrape type 2
2026-03-29 12:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: af6988aa-27fb-518d-a792-2f321a99c71f, identifier: KC04488
2026-03-29 12:11:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-29 12:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-29 12:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488 to the API
2026-03-29 12:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:35:56Z',
 'fuel_type': 'petrol',
 'id': 'af6988aa-27fb-518d-a792-2f321a99c71f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC04488',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 153034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-10',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Play',
 'transmission': 'manual',
 'trim': 'X-Play',
 'year': 2016}
2026-03-29 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-29 12:11:32 [auto1.nl] INFO: Saving data for KC04488: {'auction_closing_time': 1774884956.0, 'created_time': 1774034001.440451, 'last_price_update_time': 1774786292.442901}
2026-03-29 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC04488') HTTP/1.1" 204 0
2026-03-29 12:11:32 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-29 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-29 12:11:32 [auto1.nl] INFO: Scrape type for SK13348: 2
2026-03-29 12:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-29 12:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a4be411-cd89-5d76-bf40-b04fee70a927 with scrape type 2
2026-03-29 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a4be411-cd89-5d76-bf40-b04fee70a927 with scrape type 2
2026-03-29 12:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3a4be411-cd89-5d76-bf40-b04fee70a927, identifier: SK13348
2026-03-29 12:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-29 12:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-29 12:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348 to the API
2026-03-29 12:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:06:11Z',
 'fuel_type': 'petrol',
 'id': '3a4be411-cd89-5d76-bf40-b04fee70a927',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK13348',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-30',
 'seller_name': None,
 'title': 'BMW 3er 318i Edition Exclusive',
 'transmission': 'automatic',
 'trim': 'Edition Exclusive',
 'year': 2004}
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-29 12:11:33 [auto1.nl] INFO: Saving data for SK13348: {'auction_closing_time': 1774883171.0, 'created_time': 1774699856.575664, 'last_price_update_time': 1774786293.426446}
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SK13348') HTTP/1.1" 204 0
2026-03-29 12:11:33 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-29 12:11:33 [auto1.nl] INFO: Scrape type for JB39700: 2
2026-03-29 12:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-29 12:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02af6e8a-f01d-5d65-a501-61c7afbe6337 with scrape type 2
2026-03-29 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02af6e8a-f01d-5d65-a501-61c7afbe6337 with scrape type 2
2026-03-29 12:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02af6e8a-f01d-5d65-a501-61c7afbe6337, identifier: JB39700
2026-03-29 12:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-29 12:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-29 12:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700 to the API
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'petrol',
 'id': '02af6e8a-f01d-5d65-a501-61c7afbe6337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB39700',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 154505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-30',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-29 12:11:33 [auto1.nl] INFO: Saving data for JB39700: {'auction_closing_time': 1774883052.0, 'created_time': 1774699844.170694, 'last_price_update_time': 1774786293.811585}
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB39700') HTTP/1.1" 204 0
2026-03-29 12:11:33 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-29 12:11:33 [auto1.nl] INFO: Scrape type for NZ86515: 2
2026-03-29 12:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-29 12:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with scrape type 2
2026-03-29 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with scrape type 2
2026-03-29 12:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16, identifier: NZ86515
2026-03-29 12:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-29 12:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 12:11:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-29 12:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515 to the API
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:01:12Z',
 'fuel_type': 'petrol',
 'id': '8f083ca3-4849-5d2d-bb2b-de72c97f2e16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ86515',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 107063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-17',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-29 12:11:34 [auto1.nl] INFO: Saving data for NZ86515: {'auction_closing_time': 1774882872.0, 'created_time': 1774699848.100193, 'last_price_update_time': 1774786294.3555}
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ86515') HTTP/1.1" 204 0
2026-03-29 12:11:34 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 759 | hits on page: 0
2026-03-29 12:11:34 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-29 12:11:34 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-29 12:11:34 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-29 12:11:34 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-29 12:11:34 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-29 12:11:34 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-29 12:11:34 [auto1.nl] INFO: Scrape type for WK03460: 2
2026-03-29 12:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-29 12:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4384629a-9755-541c-83b9-7bc1cdb64060 with scrape type 2
2026-03-29 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4384629a-9755-541c-83b9-7bc1cdb64060 with scrape type 2
2026-03-29 12:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4384629a-9755-541c-83b9-7bc1cdb64060, identifier: WK03460
2026-03-29 12:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-29 12:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-29 12:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460 to the API
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:32Z',
 'fuel_type': 'petrol',
 'id': '4384629a-9755-541c-83b9-7bc1cdb64060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK03460',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 285326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-29 12:11:34 [auto1.nl] INFO: Saving data for WK03460: {'auction_closing_time': 1774884212.0, 'created_time': 1774699857.430934, 'last_price_update_time': 1774786294.72392}
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK03460') HTTP/1.1" 204 0
2026-03-29 12:11:34 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-29 12:11:34 [auto1.nl] INFO: Scrape type for FG02230: 2
2026-03-29 12:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-29 12:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e94fe0-a429-51cb-a874-beabf2585ea2 with scrape type 2
2026-03-29 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64e94fe0-a429-51cb-a874-beabf2585ea2 with scrape type 2
2026-03-29 12:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64e94fe0-a429-51cb-a874-beabf2585ea2, identifier: FG02230
2026-03-29 12:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-29 12:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-29 12:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230 to the API
2026-03-29 12:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:21Z',
 'fuel_type': 'petrol',
 'id': '64e94fe0-a429-51cb-a874-beabf2585ea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG02230',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 178651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-26',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2010}
2026-03-29 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-29 12:11:35 [auto1.nl] INFO: Saving data for FG02230: {'auction_closing_time': 1774885701.0, 'created_time': 1774699844.5519, 'last_price_update_time': 1774786295.957855}
2026-03-29 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FG02230') HTTP/1.1" 204 0
2026-03-29 12:11:35 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-29 12:11:35 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-29 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-29 12:11:35 [auto1.nl] INFO: Scrape type for NX59327: 2
2026-03-29 12:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-29 12:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with scrape type 2
2026-03-29 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with scrape type 2
2026-03-29 12:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0, identifier: NX59327
2026-03-29 12:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-29 12:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-29 12:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327 to the API
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:15:23Z',
 'fuel_type': 'petrol',
 'id': '9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX59327',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 83312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2016}
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-29 12:11:36 [auto1.nl] INFO: Saving data for NX59327: {'auction_closing_time': 1774883723.0, 'created_time': 1774699845.748042, 'last_price_update_time': 1774786296.329935}
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX59327') HTTP/1.1" 204 0
2026-03-29 12:11:36 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-29 12:11:36 [auto1.nl] INFO: Scrape type for AB36156: 2
2026-03-29 12:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-29 12:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with scrape type 2
2026-03-29 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with scrape type 2
2026-03-29 12:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f, identifier: AB36156
2026-03-29 12:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-29 12:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-29 12:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156 to the API
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:32:57Z',
 'fuel_type': 'petrol',
 'id': 'f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB36156',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 213258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-23',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2005}
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-29 12:11:36 [auto1.nl] INFO: Saving data for AB36156: {'auction_closing_time': 1774884777.0, 'created_time': 1774699843.305749, 'last_price_update_time': 1774786296.700592}
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB36156') HTTP/1.1" 204 0
2026-03-29 12:11:36 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-29 12:11:36 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-29 12:11:36 [auto1.nl] INFO: Scrape type for JW97628: 2
2026-03-29 12:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-29 12:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with scrape type 2
2026-03-29 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with scrape type 2
2026-03-29 12:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253, identifier: JW97628
2026-03-29 12:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-29 12:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-29 12:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628 to the API
2026-03-29 12:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 162,
 'expiration_date': '2026-03-30T15:49:55Z',
 'fuel_type': 'petrol',
 'id': '4bf3e8cb-800f-53ec-9b70-964ffd7eb253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW97628',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Sonata',
 'odometer': 281747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-07',
 'seller_name': None,
 'title': 'Hyundai Sonata 2.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2005}
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-29 12:11:37 [auto1.nl] INFO: Saving data for JW97628: {'auction_closing_time': 1774885795.0, 'created_time': 1774699867.662163, 'last_price_update_time': 1774786297.47198}
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW97628') HTTP/1.1" 204 0
2026-03-29 12:11:37 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-29 12:11:37 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-29 12:11:37 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-29 12:11:37 [auto1.nl] INFO: Scrape type for LR40141: 2
2026-03-29 12:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-29 12:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1209bd14-ac06-5df4-9618-dcc22a134f1f with scrape type 2
2026-03-29 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1209bd14-ac06-5df4-9618-dcc22a134f1f with scrape type 2
2026-03-29 12:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1209bd14-ac06-5df4-9618-dcc22a134f1f, identifier: LR40141
2026-03-29 12:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-29 12:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-29 12:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141 to the API
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:50:00Z',
 'fuel_type': 'petrol',
 'id': '1209bd14-ac06-5df4-9618-dcc22a134f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR40141',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 139943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-29 12:11:37 [auto1.nl] INFO: Saving data for LR40141: {'auction_closing_time': 1774885800.0, 'created_time': 1774699861.487774, 'last_price_update_time': 1774786297.976951}
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LR40141') HTTP/1.1" 204 0
2026-03-29 12:11:37 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-29 12:11:37 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-29 12:11:38 [auto1.nl] INFO: Scrape type for EP93197: 2
2026-03-29 12:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-29 12:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with scrape type 2
2026-03-29 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with scrape type 2
2026-03-29 12:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072, identifier: EP93197
2026-03-29 12:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-29 12:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-29 12:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197 to the API
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:16Z',
 'fuel_type': 'petrol',
 'id': '7c4f38ad-0cf0-5e8d-a429-4516e62c5072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP93197',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 203514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2020}
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-29 12:11:38 [auto1.nl] INFO: Saving data for EP93197: {'auction_closing_time': 1774884616.0, 'created_time': 1774699861.917669, 'last_price_update_time': 1774786298.366595}
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP93197') HTTP/1.1" 204 0
2026-03-29 12:11:38 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-29 12:11:38 [auto1.nl] INFO: Scrape type for DT42929: 2
2026-03-29 12:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-29 12:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d6700a-f12c-548c-997f-97f1bcf08383 with scrape type 2
2026-03-29 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15d6700a-f12c-548c-997f-97f1bcf08383 with scrape type 2
2026-03-29 12:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 15d6700a-f12c-548c-997f-97f1bcf08383, identifier: DT42929
2026-03-29 12:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-29 12:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-29 12:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929 to the API
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:55:13Z',
 'fuel_type': 'diesel',
 'id': '15d6700a-f12c-548c-997f-97f1bcf08383',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT42929',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 237956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-29',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM 10 SX L1H1 130 Multijet',
 'transmission': 'manual',
 'trim': '10 SX L1H1 130 Multijet',
 'year': 2012}
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-29 12:11:38 [auto1.nl] INFO: Saving data for DT42929: {'auction_closing_time': 1774886113.0, 'created_time': 1774033942.229374, 'last_price_update_time': 1774786298.843148}
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DT42929') HTTP/1.1" 204 0
2026-03-29 12:11:38 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-29 12:11:38 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-29 12:11:38 [auto1.nl] INFO: Scrape type for AV73218: 0
2026-03-29 12:11:38 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-29 12:11:38 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 12:11:38 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-29 12:11:38 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 1, <ScrapeType.BATCH_SKIPPED: 5>: 2}
2026-03-29 12:11:39 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (116 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-29T12_10_00.jl
2026-03-29 12:11:39 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 117718,
 'downloader/request_count': 48,
 'downloader/request_method_count/GET': 26,
 'downloader/request_method_count/POST': 22,
 'downloader/response_bytes': 3935054,
 'downloader/response_count': 48,
 'downloader/response_status_count/200': 48,
 'dupefilter/filtered': 4,
 'elapsed_time_seconds': 92.423604,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 12, 11, 38, 969043, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 116,
 'log_count/DEBUG': 1963,
 'log_count/INFO': 2304,
 'memusage/max': 170590208,
 'memusage/startup': 149659648,
 'request_depth_max': 23,
 'response_received_count': 48,
 'scheduler/dequeued': 48,
 'scheduler/dequeued/memory': 48,
 'scheduler/enqueued': 48,
 'scheduler/enqueued/memory': 48,
 'scrape_type/batch_skipped': 403,
 'scrape_type/new': 12,
 'scrape_type/price_update': 104,
 'scrape_type/skipped': 276,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 48,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.5348381046399786,
 'scrapy-zyte-api/mean_response_seconds': 3.5909158123540688,
 'scrapy-zyte-api/processed': 48,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 48,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 47,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 48,
 'scrapy-zyte-api/request_args/httpRequestBody': 22,
 'scrapy-zyte-api/request_args/httpRequestMethod': 22,
 'scrapy-zyte-api/request_args/httpResponseBody': 48,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 48,
 'scrapy-zyte-api/request_args/sessionContext': 48,
 'scrapy-zyte-api/request_args/url': 48,
 'scrapy-zyte-api/status_codes/200': 48,
 'scrapy-zyte-api/success': 48,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 799,
 'source/total_available': 759,
 'start_time': datetime.datetime(2026, 3, 29, 12, 10, 6, 545439, tzinfo=datetime.timezone.utc)}
2026-03-29 12:11:39 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 12:11:39 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9971541e90>
2026-03-29 12:11:39 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9971314350>