2026-03-30 05:00:11 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 05:00:11 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 05:00:11 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-30 05:00:11 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-30 05:00:11 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 05:00:11 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 05:00:11 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 05:00:11 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 05:00:11 [scrapy.extensions.telnet] INFO: Telnet Password: 06faa182e12e7e15
2026-03-30 05:00:11 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 05:00:11 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-30T05_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 05:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 05:00:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 05:00:11 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 05:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 05:00:11 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 05:00:11 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 05:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 05:00:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-30 05:00:11 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 05:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 05:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:11 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 05:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 05:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 05:00:12 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 05:00:12 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 05:00:12 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 05:00:12 [scrapy.core.engine] INFO: Spider opened
2026-03-30 05:00:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 05:00:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-30 05:00:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 05:00:12 [scrapy-playwright] INFO: Starting download handler
2026-03-30 05:00:12 [scrapy-playwright] INFO: Starting download handler
2026-03-30 05:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 05:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 05:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 05:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 05:00:52 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 758 | hits on page: 40
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for DA42701: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for WC63917: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for HK88309: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for FB29349: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for TM57044: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for NG83103: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for MW44280: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for BN75332: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for DW37625: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for CE26691: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for GR22460: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for WM06162: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for CP88423: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-30 05:00:52 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-30 05:00:52 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-30 05:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:01:12 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 4 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 05:01:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 151MiB
2026-03-30 05:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:01:13 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 758 | hits on page: 40
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for DA42701: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for WC63917: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for HK88309: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for FB29349: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for TM57044: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for NG83103: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-30 05:01:13 [auto1.nl] INFO: Scrape type for MW44280: 0
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-30 05:01:13 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-30 05:01:14 [auto1.nl] INFO: Scrape type for BN75332: 0
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-30 05:01:14 [auto1.nl] INFO: Scrape type for DW37625: 0
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-30 05:01:14 [auto1.nl] INFO: Scrape type for CE26691: 0
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-30 05:01:14 [auto1.nl] INFO: Scrape type for GR22460: 0
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-30 05:01:14 [auto1.nl] INFO: Scrape type for WM06162: 0
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-30 05:01:14 [auto1.nl] INFO: Scrape type for CP88423: 0
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-30 05:01:14 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-30 05:01:14 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-30 05:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:01:30 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 758 | hits on page: 40
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for FW01389: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE59902%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for UE59902: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for DS12539: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH12020%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for LH12020: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for JF28004: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for ZE22789: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for LW17731: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for YE49757: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU83484%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for XU83484: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for AJ89396: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for MW67597: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS28591%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for SS28591: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ12615%27 HTTP/1.1" 200 None
2026-03-30 05:01:30 [auto1.nl] INFO: Scrape type for DJ12615: 0
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-30 05:01:30 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-30 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS78045%27 HTTP/1.1" 200 None
2026-03-30 05:01:31 [auto1.nl] INFO: Scrape type for FS78045: 0
2026-03-30 05:01:31 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF33290%27 HTTP/1.1" 200 None
2026-03-30 05:01:31 [auto1.nl] INFO: Scrape type for FF33290: 0
2026-03-30 05:01:31 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-30 05:01:31 [auto1.nl] INFO: Scrape type for MB43165: 0
2026-03-30 05:01:31 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK68166%27 HTTP/1.1" 200 None
2026-03-30 05:01:31 [auto1.nl] INFO: Scrape type for DK68166: 0
2026-03-30 05:01:31 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-30 05:01:31 [auto1.nl] INFO: Scrape type for WM74497: 0
2026-03-30 05:01:31 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-30 05:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:01:37 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 758 | hits on page: 40
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS47079%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for PS47079: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV31817%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for EV31817: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH55431%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for KH55431: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG10969%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for EG10969: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for RC67109: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE96226%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for KE96226: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW61331%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for VW61331: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-30 05:01:37 [auto1.nl] INFO: Scrape type for DF82688: 0
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-30 05:01:37 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE71777%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for UE71777: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for HV97203: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for UC71604: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for HF10176: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG79878%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for UG79878: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for RL18676: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for FD60498: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW54855%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for GW54855: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for XJ86601: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for FT93592: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT87192%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for TT87192: 0
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-30 05:01:38 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-30 05:01:38 [auto1.nl] INFO: Scrape type for EP75091: 2
2026-03-30 05:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2708f25-630d-56aa-9cd4-7745c27257ea with identifier: EP75091
2026-03-30 05:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2708f25-630d-56aa-9cd4-7745c27257ea with scrape type 2
2026-03-30 05:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2708f25-630d-56aa-9cd4-7745c27257ea with scrape type 2
2026-03-30 05:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b2708f25-630d-56aa-9cd4-7745c27257ea, identifier: EP75091
2026-03-30 05:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b2708f25-630d-56aa-9cd4-7745c27257ea with identifier: EP75091
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 05:01:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 05:01:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b2708f25-630d-56aa-9cd4-7745c27257ea with identifier: EP75091
2026-03-30 05:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b2708f25-630d-56aa-9cd4-7745c27257ea with identifier: EP75091 to the API
2026-03-30 05:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:41:37Z',
 'fuel_type': 'petrol',
 'id': 'b2708f25-630d-56aa-9cd4-7745c27257ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP75091',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 111768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-07',
 'seller_name': None,
 'title': 'Opel Agila 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 05:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-30 05:01:39 [auto1.nl] INFO: Saving data for EP75091: {'auction_closing_time': 1774885297.0, 'created_time': 1774724452.324599, 'last_price_update_time': 1774846899.776012}
2026-03-30 05:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP75091') HTTP/1.1" 204 0
2026-03-30 05:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:01:39 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-30 05:01:39 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-30 05:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-30 05:01:39 [auto1.nl] INFO: Scrape type for PT29526: 2
2026-03-30 05:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d170a6a4-9bab-5705-ae24-a0f2b41431a6 with identifier: PT29526
2026-03-30 05:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d170a6a4-9bab-5705-ae24-a0f2b41431a6 with scrape type 2
2026-03-30 05:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d170a6a4-9bab-5705-ae24-a0f2b41431a6 with scrape type 2
2026-03-30 05:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d170a6a4-9bab-5705-ae24-a0f2b41431a6, identifier: PT29526
2026-03-30 05:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d170a6a4-9bab-5705-ae24-a0f2b41431a6 with identifier: PT29526
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 05:01:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d170a6a4-9bab-5705-ae24-a0f2b41431a6 with identifier: PT29526
2026-03-30 05:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d170a6a4-9bab-5705-ae24-a0f2b41431a6 with identifier: PT29526 to the API
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:49:30Z',
 'fuel_type': 'petrol',
 'id': 'd170a6a4-9bab-5705-ae24-a0f2b41431a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT29526',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 115178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-30 05:01:40 [auto1.nl] INFO: Saving data for PT29526: {'auction_closing_time': 1774885770.0, 'created_time': 1774724425.802126, 'last_price_update_time': 1774846900.410555}
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PT29526') HTTP/1.1" 204 0
2026-03-30 05:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:01:44 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 758 | hits on page: 40
2026-03-30 05:01:44 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-30 05:01:44 [auto1.nl] INFO: Scrape type for LT58475: 0
2026-03-30 05:01:44 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-30 05:01:44 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-30 05:01:44 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-30 05:01:44 [auto1.nl] INFO: Scrape type for ZU81802: 2
2026-03-30 05:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32de9075-0881-591d-93e4-1169e36d2b66 with identifier: ZU81802
2026-03-30 05:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32de9075-0881-591d-93e4-1169e36d2b66 with scrape type 2
2026-03-30 05:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32de9075-0881-591d-93e4-1169e36d2b66 with scrape type 2
2026-03-30 05:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32de9075-0881-591d-93e4-1169e36d2b66, identifier: ZU81802
2026-03-30 05:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32de9075-0881-591d-93e4-1169e36d2b66 with identifier: ZU81802
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 05:01:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32de9075-0881-591d-93e4-1169e36d2b66 with identifier: ZU81802
2026-03-30 05:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32de9075-0881-591d-93e4-1169e36d2b66 with identifier: ZU81802 to the API
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:13:17Z',
 'fuel_type': 'petrol',
 'id': '32de9075-0881-591d-93e4-1169e36d2b66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU81802',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 255002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-13',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-30 05:01:44 [auto1.nl] INFO: Saving data for ZU81802: {'auction_closing_time': 1774883597.0, 'created_time': 1774724428.343342, 'last_price_update_time': 1774846904.718883}
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZU81802') HTTP/1.1" 204 0
2026-03-30 05:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:01:44 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-30 05:01:44 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-30 05:01:44 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-30 05:01:44 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-30 05:01:44 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-30 05:01:44 [auto1.nl] INFO: Scrape type for AR18023: 2
2026-03-30 05:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with identifier: AR18023
2026-03-30 05:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with scrape type 2
2026-03-30 05:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with scrape type 2
2026-03-30 05:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2, identifier: AR18023
2026-03-30 05:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with identifier: AR18023
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:01:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 05:01:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with identifier: AR18023
2026-03-30 05:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2 with identifier: AR18023 to the API
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-30T15:52:55Z',
 'fuel_type': 'hybrid',
 'id': '8d6fdcfe-df6f-54fd-856d-5bd0bf94e8a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR18023',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 127969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-14',
 'seller_name': None,
 'title': 'Audi Q7 3.0 TDI e-tron quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-30 05:01:45 [auto1.nl] INFO: Saving data for AR18023: {'auction_closing_time': 1774885975.0, 'created_time': 1774724429.704676, 'last_price_update_time': 1774846905.31779}
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AR18023') HTTP/1.1" 204 0
2026-03-30 05:01:45 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-30 05:01:45 [auto1.nl] INFO: Scrape type for VV23298: 0
2026-03-30 05:01:45 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-30 05:01:45 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-30 05:01:45 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-30 05:01:45 [auto1.nl] INFO: Scrape type for TA68954: 0
2026-03-30 05:01:45 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-30 05:01:45 [auto1.nl] INFO: Scrape type for MC92565: 2
2026-03-30 05:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b663251-2061-5ae3-8887-c9b9d3ac403b with identifier: MC92565
2026-03-30 05:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b663251-2061-5ae3-8887-c9b9d3ac403b with scrape type 2
2026-03-30 05:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b663251-2061-5ae3-8887-c9b9d3ac403b with scrape type 2
2026-03-30 05:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3b663251-2061-5ae3-8887-c9b9d3ac403b, identifier: MC92565
2026-03-30 05:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3b663251-2061-5ae3-8887-c9b9d3ac403b with identifier: MC92565
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 05:01:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 05:01:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3b663251-2061-5ae3-8887-c9b9d3ac403b with identifier: MC92565
2026-03-30 05:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3b663251-2061-5ae3-8887-c9b9d3ac403b with identifier: MC92565 to the API
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:22:39Z',
 'fuel_type': 'diesel',
 'id': '3b663251-2061-5ae3-8887-c9b9d3ac403b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC92565',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 260330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt Trend',
 'transmission': 'automatic',
 'trim': 'kompakt Trend',
 'year': 2007}
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-30 05:01:45 [auto1.nl] INFO: Saving data for MC92565: {'auction_closing_time': 1774884159.0, 'created_time': 1774724436.09668, 'last_price_update_time': 1774846905.98529}
2026-03-30 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MC92565') HTTP/1.1" 204 0
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Scrape type for JB49049: 2
2026-03-30 05:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0191a4-a2d9-5653-9461-a14e58c94269 with identifier: JB49049
2026-03-30 05:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0191a4-a2d9-5653-9461-a14e58c94269 with scrape type 2
2026-03-30 05:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0191a4-a2d9-5653-9461-a14e58c94269 with scrape type 2
2026-03-30 05:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7f0191a4-a2d9-5653-9461-a14e58c94269, identifier: JB49049
2026-03-30 05:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7f0191a4-a2d9-5653-9461-a14e58c94269 with identifier: JB49049
2026-03-30 05:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7f0191a4-a2d9-5653-9461-a14e58c94269 with identifier: JB49049
2026-03-30 05:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7f0191a4-a2d9-5653-9461-a14e58c94269 with identifier: JB49049 to the API
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:24:12Z',
 'fuel_type': 'petrol',
 'id': '7f0191a4-a2d9-5653-9461-a14e58c94269',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB49049',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 239436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-14',
 'seller_name': None,
 'title': 'Audi A4 2.4 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Saving data for JB49049: {'auction_closing_time': 1774884252.0, 'created_time': 1774638171.00406, 'last_price_update_time': 1774846906.461601}
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB49049') HTTP/1.1" 204 0
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-30 05:01:46 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-30 05:01:46 [auto1.nl] INFO: Scrape type for HB74565: 2
2026-03-30 05:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e68c6212-7dee-5853-aa86-6c0136a96ff6 with identifier: HB74565
2026-03-30 05:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e68c6212-7dee-5853-aa86-6c0136a96ff6 with scrape type 2
2026-03-30 05:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e68c6212-7dee-5853-aa86-6c0136a96ff6 with scrape type 2
2026-03-30 05:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e68c6212-7dee-5853-aa86-6c0136a96ff6, identifier: HB74565
2026-03-30 05:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e68c6212-7dee-5853-aa86-6c0136a96ff6 with identifier: HB74565
2026-03-30 05:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e68c6212-7dee-5853-aa86-6c0136a96ff6 with identifier: HB74565
2026-03-30 05:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e68c6212-7dee-5853-aa86-6c0136a96ff6 with identifier: HB74565 to the API
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:37:28Z',
 'fuel_type': 'petrol',
 'id': 'e68c6212-7dee-5853-aa86-6c0136a96ff6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB74565',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 125391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-04',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-30 05:01:47 [auto1.nl] INFO: Saving data for HB74565: {'auction_closing_time': 1774885048.0, 'created_time': 1774551628.122595, 'last_price_update_time': 1774846907.027065}
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HB74565') HTTP/1.1" 204 0
2026-03-30 05:01:47 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-30 05:01:47 [auto1.nl] INFO: Scrape type for RL60639: 2
2026-03-30 05:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be61198-ed56-5fa9-b4a6-6a7834108b63 with identifier: RL60639
2026-03-30 05:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be61198-ed56-5fa9-b4a6-6a7834108b63 with scrape type 2
2026-03-30 05:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2be61198-ed56-5fa9-b4a6-6a7834108b63 with scrape type 2
2026-03-30 05:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2be61198-ed56-5fa9-b4a6-6a7834108b63, identifier: RL60639
2026-03-30 05:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2be61198-ed56-5fa9-b4a6-6a7834108b63 with identifier: RL60639
2026-03-30 05:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2be61198-ed56-5fa9-b4a6-6a7834108b63 with identifier: RL60639
2026-03-30 05:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2be61198-ed56-5fa9-b4a6-6a7834108b63 with identifier: RL60639 to the API
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:06:46Z',
 'fuel_type': 'petrol',
 'id': '2be61198-ed56-5fa9-b4a6-6a7834108b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL60639',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 180970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-30 05:01:47 [auto1.nl] INFO: Saving data for RL60639: {'auction_closing_time': 1774883206.0, 'created_time': 1774638138.186266, 'last_price_update_time': 1774846907.54739}
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RL60639') HTTP/1.1" 204 0
2026-03-30 05:01:47 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-30 05:01:47 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-30 05:01:47 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-30 05:01:47 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-30 05:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:02:05 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 758 | hits on page: 40
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-30 05:02:05 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-30 05:02:05 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-30 05:02:05 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-30 05:02:05 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-30 05:02:05 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-30 05:02:05 [auto1.nl] INFO: Scrape type for MP54654: 2
2026-03-30 05:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a063b15f-6721-52ae-adc3-10c03f6e7901 with identifier: MP54654
2026-03-30 05:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a063b15f-6721-52ae-adc3-10c03f6e7901 with scrape type 2
2026-03-30 05:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a063b15f-6721-52ae-adc3-10c03f6e7901 with scrape type 2
2026-03-30 05:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a063b15f-6721-52ae-adc3-10c03f6e7901, identifier: MP54654
2026-03-30 05:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a063b15f-6721-52ae-adc3-10c03f6e7901 with identifier: MP54654
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 05:02:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a063b15f-6721-52ae-adc3-10c03f6e7901 with identifier: MP54654
2026-03-30 05:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a063b15f-6721-52ae-adc3-10c03f6e7901 with identifier: MP54654 to the API
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:02:17Z',
 'fuel_type': 'diesel',
 'id': 'a063b15f-6721-52ae-adc3-10c03f6e7901',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP54654',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 147695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-30 05:02:05 [auto1.nl] INFO: Saving data for MP54654: {'auction_closing_time': 1774882937.0, 'created_time': 1773923498.998397, 'last_price_update_time': 1774846925.964585}
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP54654') HTTP/1.1" 204 0
2026-03-30 05:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:02:06 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-30 05:02:06 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-30 05:02:06 [auto1.nl] INFO: Scrape type for VF61988: 2
2026-03-30 05:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d9cc7d2-3682-536e-a507-90192b8e10ac with identifier: VF61988
2026-03-30 05:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d9cc7d2-3682-536e-a507-90192b8e10ac with scrape type 2
2026-03-30 05:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d9cc7d2-3682-536e-a507-90192b8e10ac with scrape type 2
2026-03-30 05:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5d9cc7d2-3682-536e-a507-90192b8e10ac, identifier: VF61988
2026-03-30 05:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5d9cc7d2-3682-536e-a507-90192b8e10ac with identifier: VF61988
2026-03-30 05:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5d9cc7d2-3682-536e-a507-90192b8e10ac with identifier: VF61988
2026-03-30 05:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5d9cc7d2-3682-536e-a507-90192b8e10ac with identifier: VF61988 to the API
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:29:53Z',
 'fuel_type': 'petrol',
 'id': '5d9cc7d2-3682-536e-a507-90192b8e10ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF61988',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 111535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-15',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-30 05:02:06 [auto1.nl] INFO: Saving data for VF61988: {'auction_closing_time': 1774884593.0, 'created_time': 1774638055.051887, 'last_price_update_time': 1774846926.443391}
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VF61988') HTTP/1.1" 204 0
2026-03-30 05:02:06 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-30 05:02:06 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-30 05:02:06 [auto1.nl] INFO: Scrape type for DE05380: 2
2026-03-30 05:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c0d279-c2a7-5053-8de8-0f6fd8635142 with identifier: DE05380
2026-03-30 05:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c0d279-c2a7-5053-8de8-0f6fd8635142 with scrape type 2
2026-03-30 05:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c0d279-c2a7-5053-8de8-0f6fd8635142 with scrape type 2
2026-03-30 05:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96c0d279-c2a7-5053-8de8-0f6fd8635142, identifier: DE05380
2026-03-30 05:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96c0d279-c2a7-5053-8de8-0f6fd8635142 with identifier: DE05380
2026-03-30 05:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96c0d279-c2a7-5053-8de8-0f6fd8635142 with identifier: DE05380
2026-03-30 05:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96c0d279-c2a7-5053-8de8-0f6fd8635142 with identifier: DE05380 to the API
2026-03-30 05:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:05:25Z',
 'fuel_type': 'petrol',
 'id': '96c0d279-c2a7-5053-8de8-0f6fd8635142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE05380',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 203988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTI BlueMotion Tech',
 'year': 2013}
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-30 05:02:07 [auto1.nl] INFO: Saving data for DE05380: {'auction_closing_time': 1774883125.0, 'created_time': 1774638158.832455, 'last_price_update_time': 1774846927.687366}
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DE05380') HTTP/1.1" 204 0
2026-03-30 05:02:07 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-30 05:02:07 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-30 05:02:07 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-30 05:02:07 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-30 05:02:07 [auto1.nl] INFO: Scrape type for GR72952: 2
2026-03-30 05:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with identifier: GR72952
2026-03-30 05:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with scrape type 2
2026-03-30 05:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with scrape type 2
2026-03-30 05:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2, identifier: GR72952
2026-03-30 05:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with identifier: GR72952
2026-03-30 05:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with identifier: GR72952
2026-03-30 05:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with identifier: GR72952 to the API
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:55:06Z',
 'fuel_type': 'diesel',
 'id': 'f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR72952',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 223414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-30 05:02:08 [auto1.nl] INFO: Saving data for GR72952: {'auction_closing_time': 1774886106.0, 'created_time': 1774551680.773495, 'last_price_update_time': 1774846928.105984}
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GR72952') HTTP/1.1" 204 0
2026-03-30 05:02:08 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-30 05:02:08 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-30 05:02:08 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-30 05:02:08 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-30 05:02:08 [auto1.nl] INFO: Scrape type for ET47420: 2
2026-03-30 05:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2d06973-cd18-582c-8c4c-98d104182ab4 with identifier: ET47420
2026-03-30 05:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d06973-cd18-582c-8c4c-98d104182ab4 with scrape type 2
2026-03-30 05:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2d06973-cd18-582c-8c4c-98d104182ab4 with scrape type 2
2026-03-30 05:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c2d06973-cd18-582c-8c4c-98d104182ab4, identifier: ET47420
2026-03-30 05:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c2d06973-cd18-582c-8c4c-98d104182ab4 with identifier: ET47420
2026-03-30 05:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c2d06973-cd18-582c-8c4c-98d104182ab4 with identifier: ET47420
2026-03-30 05:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c2d06973-cd18-582c-8c4c-98d104182ab4 with identifier: ET47420 to the API
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:23:18Z',
 'fuel_type': 'petrol',
 'id': 'c2d06973-cd18-582c-8c4c-98d104182ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET47420',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 141024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-23',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Blackjack',
 'transmission': 'manual',
 'trim': 'Blackjack',
 'year': 2011}
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-30 05:02:08 [auto1.nl] INFO: Saving data for ET47420: {'auction_closing_time': 1774884198.0, 'created_time': 1774724466.837789, 'last_price_update_time': 1774846928.520933}
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ET47420') HTTP/1.1" 204 0
2026-03-30 05:02:08 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-30 05:02:08 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-30 05:02:08 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-30 05:02:08 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-30 05:02:08 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-30 05:02:08 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-30 05:02:08 [auto1.nl] INFO: Scrape type for JK36770: 2
2026-03-30 05:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 500b09a5-838c-5a73-8fa1-e91fb40402f1 with identifier: JK36770
2026-03-30 05:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 500b09a5-838c-5a73-8fa1-e91fb40402f1 with scrape type 2
2026-03-30 05:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 500b09a5-838c-5a73-8fa1-e91fb40402f1 with scrape type 2
2026-03-30 05:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 500b09a5-838c-5a73-8fa1-e91fb40402f1, identifier: JK36770
2026-03-30 05:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 500b09a5-838c-5a73-8fa1-e91fb40402f1 with identifier: JK36770
2026-03-30 05:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 500b09a5-838c-5a73-8fa1-e91fb40402f1 with identifier: JK36770
2026-03-30 05:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 500b09a5-838c-5a73-8fa1-e91fb40402f1 with identifier: JK36770 to the API
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:37:42Z',
 'fuel_type': 'petrol',
 'id': '500b09a5-838c-5a73-8fa1-e91fb40402f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK36770',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 242967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-03',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-30 05:02:09 [auto1.nl] INFO: Saving data for JK36770: {'auction_closing_time': 1774885062.0, 'created_time': 1774551632.388114, 'last_price_update_time': 1774846929.080988}
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK36770') HTTP/1.1" 204 0
2026-03-30 05:02:09 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-30 05:02:09 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-30 05:02:09 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-30 05:02:09 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-30 05:02:09 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-30 05:02:09 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-30 05:02:09 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-30 05:02:09 [auto1.nl] INFO: Scrape type for LA17019: 2
2026-03-30 05:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with identifier: LA17019
2026-03-30 05:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with scrape type 2
2026-03-30 05:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with scrape type 2
2026-03-30 05:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 16fa622e-c4cd-5e07-b1f2-5ca828e39398, identifier: LA17019
2026-03-30 05:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with identifier: LA17019
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 05:02:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with identifier: LA17019
2026-03-30 05:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with identifier: LA17019 to the API
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:50:36Z',
 'fuel_type': 'petrol',
 'id': '16fa622e-c4cd-5e07-b1f2-5ca828e39398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA17019',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 104876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-30 05:02:09 [auto1.nl] INFO: Saving data for LA17019: {'auction_closing_time': 1774885836.0, 'created_time': 1773132632.739229, 'last_price_update_time': 1774846929.695764}
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA17019') HTTP/1.1" 204 0
2026-03-30 05:02:09 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-30 05:02:09 [auto1.nl] INFO: Scrape type for NZ11721: 2
2026-03-30 05:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8072fe1-ae28-5bee-952c-633e35a4d98b with identifier: NZ11721
2026-03-30 05:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8072fe1-ae28-5bee-952c-633e35a4d98b with scrape type 2
2026-03-30 05:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8072fe1-ae28-5bee-952c-633e35a4d98b with scrape type 2
2026-03-30 05:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d8072fe1-ae28-5bee-952c-633e35a4d98b, identifier: NZ11721
2026-03-30 05:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d8072fe1-ae28-5bee-952c-633e35a4d98b with identifier: NZ11721
2026-03-30 05:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d8072fe1-ae28-5bee-952c-633e35a4d98b with identifier: NZ11721
2026-03-30 05:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d8072fe1-ae28-5bee-952c-633e35a4d98b with identifier: NZ11721 to the API
2026-03-30 05:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:55:17Z',
 'fuel_type': 'petrol',
 'id': 'd8072fe1-ae28-5bee-952c-633e35a4d98b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ11721',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 83691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-30 05:02:10 [auto1.nl] INFO: Saving data for NZ11721: {'auction_closing_time': 1774886117.0, 'created_time': 1774638053.692116, 'last_price_update_time': 1774846930.145692}
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ11721') HTTP/1.1" 204 0
2026-03-30 05:02:10 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-30 05:02:10 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-30 05:02:10 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-30 05:02:10 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-30 05:02:10 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-30 05:02:10 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-30 05:02:10 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-30 05:02:10 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-30 05:02:10 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-30 05:02:10 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-30 05:02:10 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-30 05:02:10 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-30 05:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:02:10 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 758 | hits on page: 40
2026-03-30 05:02:10 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-30 05:02:10 [auto1.nl] INFO: Scrape type for UD40907: 2
2026-03-30 05:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with identifier: UD40907
2026-03-30 05:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with scrape type 2
2026-03-30 05:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with scrape type 2
2026-03-30 05:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b, identifier: UD40907
2026-03-30 05:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with identifier: UD40907
2026-03-30 05:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with identifier: UD40907
2026-03-30 05:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with identifier: UD40907 to the API
2026-03-30 05:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:19:52Z',
 'fuel_type': 'petrol',
 'id': '8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD40907',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 191741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-03',
 'seller_name': None,
 'title': 'Ford Focus 1.8 Black Magic',
 'transmission': 'manual',
 'trim': 'Black Magic',
 'year': 2010}
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-30 05:02:11 [auto1.nl] INFO: Saving data for UD40907: {'auction_closing_time': 1774883992.0, 'created_time': 1774638172.177141, 'last_price_update_time': 1774846931.141069}
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UD40907') HTTP/1.1" 204 0
2026-03-30 05:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:02:11 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-30 05:02:11 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-30 05:02:11 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-30 05:02:11 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-30 05:02:11 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-30 05:02:11 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-30 05:02:11 [auto1.nl] INFO: Scrape type for NZ51488: 2
2026-03-30 05:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51538c51-298e-51c1-8cf3-c30dbdf8f838 with identifier: NZ51488
2026-03-30 05:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51538c51-298e-51c1-8cf3-c30dbdf8f838 with scrape type 2
2026-03-30 05:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51538c51-298e-51c1-8cf3-c30dbdf8f838 with scrape type 2
2026-03-30 05:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 51538c51-298e-51c1-8cf3-c30dbdf8f838, identifier: NZ51488
2026-03-30 05:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 51538c51-298e-51c1-8cf3-c30dbdf8f838 with identifier: NZ51488
2026-03-30 05:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 51538c51-298e-51c1-8cf3-c30dbdf8f838 with identifier: NZ51488
2026-03-30 05:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 51538c51-298e-51c1-8cf3-c30dbdf8f838 with identifier: NZ51488 to the API
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'petrol',
 'id': '51538c51-298e-51c1-8cf3-c30dbdf8f838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ51488',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 149349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-08',
 'seller_name': None,
 'title': 'Kia Sorento 3.5 V6 EX',
 'transmission': 'automatic',
 'trim': 'EX',
 'year': 2004}
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-30 05:02:11 [auto1.nl] INFO: Saving data for NZ51488: {'auction_closing_time': 1774883065.0, 'created_time': 1773921682.011593, 'last_price_update_time': 1774846931.622263}
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ51488') HTTP/1.1" 204 0
2026-03-30 05:02:11 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-30 05:02:11 [auto1.nl] INFO: Scrape type for EK85406: 2
2026-03-30 05:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40365f6a-9594-580b-8100-df4e29dc5945 with identifier: EK85406
2026-03-30 05:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40365f6a-9594-580b-8100-df4e29dc5945 with scrape type 2
2026-03-30 05:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40365f6a-9594-580b-8100-df4e29dc5945 with scrape type 2
2026-03-30 05:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40365f6a-9594-580b-8100-df4e29dc5945, identifier: EK85406
2026-03-30 05:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40365f6a-9594-580b-8100-df4e29dc5945 with identifier: EK85406
2026-03-30 05:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40365f6a-9594-580b-8100-df4e29dc5945 with identifier: EK85406
2026-03-30 05:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40365f6a-9594-580b-8100-df4e29dc5945 with identifier: EK85406 to the API
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:57:21Z',
 'fuel_type': 'petrol',
 'id': '40365f6a-9594-580b-8100-df4e29dc5945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK85406',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 116513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-22',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-30 05:02:12 [auto1.nl] INFO: Saving data for EK85406: {'auction_closing_time': 1774886241.0, 'created_time': 1774638054.693519, 'last_price_update_time': 1774846932.106215}
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK85406') HTTP/1.1" 204 0
2026-03-30 05:02:12 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-30 05:02:12 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-30 05:02:12 [auto1.nl] INFO: Scrape type for BW31181: 2
2026-03-30 05:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with identifier: BW31181
2026-03-30 05:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with scrape type 2
2026-03-30 05:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with scrape type 2
2026-03-30 05:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd, identifier: BW31181
2026-03-30 05:02:12 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 6 pages/min), scraped 19 items (at 19 items/min)
2026-03-30 05:02:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-30 05:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with identifier: BW31181
2026-03-30 05:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with identifier: BW31181
2026-03-30 05:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with identifier: BW31181 to the API
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:22:18Z',
 'fuel_type': 'petrol',
 'id': 'a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW31181',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 133379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2018}
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-30 05:02:12 [auto1.nl] INFO: Saving data for BW31181: {'auction_closing_time': 1774884138.0, 'created_time': 1773132071.053099, 'last_price_update_time': 1774846932.504306}
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BW31181') HTTP/1.1" 204 0
2026-03-30 05:02:12 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-30 05:02:12 [auto1.nl] INFO: Scrape type for VM45476: 0
2026-03-30 05:02:12 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-30 05:02:12 [auto1.nl] INFO: Scrape type for KA53212: 2
2026-03-30 05:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95803e74-134a-5083-8fa3-7bd184c15d8d with identifier: KA53212
2026-03-30 05:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95803e74-134a-5083-8fa3-7bd184c15d8d with scrape type 2
2026-03-30 05:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95803e74-134a-5083-8fa3-7bd184c15d8d with scrape type 2
2026-03-30 05:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 95803e74-134a-5083-8fa3-7bd184c15d8d, identifier: KA53212
2026-03-30 05:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 95803e74-134a-5083-8fa3-7bd184c15d8d with identifier: KA53212
2026-03-30 05:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 95803e74-134a-5083-8fa3-7bd184c15d8d with identifier: KA53212
2026-03-30 05:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 95803e74-134a-5083-8fa3-7bd184c15d8d with identifier: KA53212 to the API
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:05Z',
 'fuel_type': 'diesel',
 'id': '95803e74-134a-5083-8fa3-7bd184c15d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA53212',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 288012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-18',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TD FT 300 Kurz',
 'transmission': 'manual',
 'trim': 'FT 300 Kurz',
 'year': 2002}
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-30 05:02:13 [auto1.nl] INFO: Saving data for KA53212: {'auction_closing_time': 1774886225.0, 'created_time': 1773921686.672025, 'last_price_update_time': 1774846933.086763}
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KA53212') HTTP/1.1" 204 0
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-30 05:02:13 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-30 05:02:13 [auto1.nl] INFO: Scrape type for FD12318: 2
2026-03-30 05:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7bf4782-045f-5465-8d63-b67681dd239a with identifier: FD12318
2026-03-30 05:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7bf4782-045f-5465-8d63-b67681dd239a with scrape type 2
2026-03-30 05:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7bf4782-045f-5465-8d63-b67681dd239a with scrape type 2
2026-03-30 05:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7bf4782-045f-5465-8d63-b67681dd239a, identifier: FD12318
2026-03-30 05:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7bf4782-045f-5465-8d63-b67681dd239a with identifier: FD12318
2026-03-30 05:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7bf4782-045f-5465-8d63-b67681dd239a with identifier: FD12318
2026-03-30 05:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7bf4782-045f-5465-8d63-b67681dd239a with identifier: FD12318 to the API
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:39:25Z',
 'fuel_type': 'petrol',
 'id': 'a7bf4782-045f-5465-8d63-b67681dd239a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD12318',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Cuore',
 'odometer': 157553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-27',
 'seller_name': None,
 'title': 'Daihatsu Cuore 1.0 Chili',
 'transmission': 'manual',
 'trim': 'Chili',
 'year': 2006}
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-30 05:02:13 [auto1.nl] INFO: Saving data for FD12318: {'auction_closing_time': 1774885165.0, 'created_time': 1774551640.971748, 'last_price_update_time': 1774846933.516237}
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD12318') HTTP/1.1" 204 0
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-30 05:02:13 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-30 05:02:13 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-30 05:02:13 [auto1.nl] INFO: Scrape type for JR89598: 2
2026-03-30 05:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with identifier: JR89598
2026-03-30 05:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with scrape type 2
2026-03-30 05:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with scrape type 2
2026-03-30 05:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b, identifier: JR89598
2026-03-30 05:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with identifier: JR89598
2026-03-30 05:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with identifier: JR89598
2026-03-30 05:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with identifier: JR89598 to the API
2026-03-30 05:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:59:16Z',
 'fuel_type': 'hybrid',
 'id': '3e2f8f49-4a2b-524b-85a5-0f8b63eb002b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR89598',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 231019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Hybrid T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-30 05:02:14 [auto1.nl] INFO: Saving data for JR89598: {'auction_closing_time': 1774886356.0, 'created_time': 1773132873.475734, 'last_price_update_time': 1774846934.13153}
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JR89598') HTTP/1.1" 204 0
2026-03-30 05:02:14 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-30 05:02:14 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-30 05:02:14 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-30 05:02:14 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-30 05:02:14 [auto1.nl] INFO: Scrape type for XY67301: 2
2026-03-30 05:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53f74ec2-b968-5eb3-a74f-be295b6f0aef with identifier: XY67301
2026-03-30 05:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53f74ec2-b968-5eb3-a74f-be295b6f0aef with scrape type 2
2026-03-30 05:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53f74ec2-b968-5eb3-a74f-be295b6f0aef with scrape type 2
2026-03-30 05:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 53f74ec2-b968-5eb3-a74f-be295b6f0aef, identifier: XY67301
2026-03-30 05:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 53f74ec2-b968-5eb3-a74f-be295b6f0aef with identifier: XY67301
2026-03-30 05:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 53f74ec2-b968-5eb3-a74f-be295b6f0aef with identifier: XY67301
2026-03-30 05:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 53f74ec2-b968-5eb3-a74f-be295b6f0aef with identifier: XY67301 to the API
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:19:52Z',
 'fuel_type': 'petrol',
 'id': '53f74ec2-b968-5eb3-a74f-be295b6f0aef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY67301',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 83449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-05',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2017}
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-30 05:02:14 [auto1.nl] INFO: Saving data for XY67301: {'auction_closing_time': 1774883992.0, 'created_time': 1773134418.696533, 'last_price_update_time': 1774846934.610797}
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY67301') HTTP/1.1" 204 0
2026-03-30 05:02:14 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-30 05:02:14 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-30 05:02:14 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-30 05:02:14 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-30 05:02:14 [auto1.nl] INFO: Scrape type for WV54622: 2
2026-03-30 05:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea621380-23dc-5f4d-a572-bd135e241e18 with identifier: WV54622
2026-03-30 05:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea621380-23dc-5f4d-a572-bd135e241e18 with scrape type 2
2026-03-30 05:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea621380-23dc-5f4d-a572-bd135e241e18 with scrape type 2
2026-03-30 05:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea621380-23dc-5f4d-a572-bd135e241e18, identifier: WV54622
2026-03-30 05:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea621380-23dc-5f4d-a572-bd135e241e18 with identifier: WV54622
2026-03-30 05:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea621380-23dc-5f4d-a572-bd135e241e18 with identifier: WV54622
2026-03-30 05:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea621380-23dc-5f4d-a572-bd135e241e18 with identifier: WV54622 to the API
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:30:09Z',
 'fuel_type': 'petrol',
 'id': 'ea621380-23dc-5f4d-a572-bd135e241e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV54622',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 134825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2018}
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-30 05:02:15 [auto1.nl] INFO: Saving data for WV54622: {'auction_closing_time': 1774884609.0, 'created_time': 1774638161.202138, 'last_price_update_time': 1774846935.036296}
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WV54622') HTTP/1.1" 204 0
2026-03-30 05:02:15 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-30 05:02:15 [auto1.nl] INFO: Scrape type for TN92622: 2
2026-03-30 05:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with identifier: TN92622
2026-03-30 05:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with scrape type 2
2026-03-30 05:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with scrape type 2
2026-03-30 05:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d, identifier: TN92622
2026-03-30 05:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with identifier: TN92622
2026-03-30 05:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with identifier: TN92622
2026-03-30 05:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with identifier: TN92622 to the API
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:48:42Z',
 'fuel_type': 'petrol',
 'id': '686ec9ee-17b2-5b45-91b2-6db66bb98e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN92622',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 250599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-14',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Edition 125',
 'transmission': 'manual',
 'trim': 'Edition 125',
 'year': 2011}
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-30 05:02:15 [auto1.nl] INFO: Saving data for TN92622: {'auction_closing_time': 1774885722.0, 'created_time': 1774638152.002719, 'last_price_update_time': 1774846935.549145}
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN92622') HTTP/1.1" 204 0
2026-03-30 05:02:15 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-30 05:02:15 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-30 05:02:15 [auto1.nl] INFO: Scrape type for PM71197: 2
2026-03-30 05:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with identifier: PM71197
2026-03-30 05:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with scrape type 2
2026-03-30 05:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with scrape type 2
2026-03-30 05:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 12e6d916-46a6-5392-ba4f-b2228deeb1e4, identifier: PM71197
2026-03-30 05:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with identifier: PM71197
2026-03-30 05:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with identifier: PM71197
2026-03-30 05:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with identifier: PM71197 to the API
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:05:33Z',
 'fuel_type': 'petrol',
 'id': '12e6d916-46a6-5392-ba4f-b2228deeb1e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM71197',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 151062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seller_name': None,
 'title': 'BMW 2er 220i Gran Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-30 05:02:15 [auto1.nl] INFO: Saving data for PM71197: {'auction_closing_time': 1774883133.0, 'created_time': 1773921657.450634, 'last_price_update_time': 1774846935.999402}
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PM71197') HTTP/1.1" 204 0
2026-03-30 05:02:16 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-30 05:02:16 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-30 05:02:16 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-30 05:02:16 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-30 05:02:16 [auto1.nl] INFO: Scrape type for SE99372: 2
2026-03-30 05:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f93ef787-8d36-5225-b349-a44182ad45ef with identifier: SE99372
2026-03-30 05:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f93ef787-8d36-5225-b349-a44182ad45ef with scrape type 2
2026-03-30 05:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f93ef787-8d36-5225-b349-a44182ad45ef with scrape type 2
2026-03-30 05:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f93ef787-8d36-5225-b349-a44182ad45ef, identifier: SE99372
2026-03-30 05:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f93ef787-8d36-5225-b349-a44182ad45ef with identifier: SE99372
2026-03-30 05:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f93ef787-8d36-5225-b349-a44182ad45ef with identifier: SE99372
2026-03-30 05:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f93ef787-8d36-5225-b349-a44182ad45ef with identifier: SE99372 to the API
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:27:05Z',
 'fuel_type': 'petrol',
 'id': 'f93ef787-8d36-5225-b349-a44182ad45ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE99372',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 146405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-30 05:02:16 [auto1.nl] INFO: Saving data for SE99372: {'auction_closing_time': 1774884425.0, 'created_time': 1774724448.131259, 'last_price_update_time': 1774846936.391169}
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE99372') HTTP/1.1" 204 0
2026-03-30 05:02:16 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-30 05:02:16 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-30 05:02:16 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-30 05:02:16 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-30 05:02:16 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-30 05:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:02:19 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 758 | hits on page: 40
2026-03-30 05:02:19 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-30 05:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-30 05:02:19 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-30 05:02:19 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-30 05:02:19 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-30 05:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-30 05:02:19 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-30 05:02:19 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-30 05:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-30 05:02:19 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-30 05:02:19 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-30 05:02:19 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-30 05:02:19 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-30 05:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-30 05:02:19 [auto1.nl] INFO: Scrape type for DY48945: 2
2026-03-30 05:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932ce692-33f7-5822-8d2a-318f69891fe6 with identifier: DY48945
2026-03-30 05:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932ce692-33f7-5822-8d2a-318f69891fe6 with scrape type 2
2026-03-30 05:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932ce692-33f7-5822-8d2a-318f69891fe6 with scrape type 2
2026-03-30 05:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 932ce692-33f7-5822-8d2a-318f69891fe6, identifier: DY48945
2026-03-30 05:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 932ce692-33f7-5822-8d2a-318f69891fe6 with identifier: DY48945
2026-03-30 05:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 932ce692-33f7-5822-8d2a-318f69891fe6 with identifier: DY48945
2026-03-30 05:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 932ce692-33f7-5822-8d2a-318f69891fe6 with identifier: DY48945 to the API
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:24:04Z',
 'fuel_type': 'diesel',
 'id': '932ce692-33f7-5822-8d2a-318f69891fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY48945',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 180748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2016}
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-30 05:02:20 [auto1.nl] INFO: Saving data for DY48945: {'auction_closing_time': 1774884244.0, 'created_time': 1774638088.030508, 'last_price_update_time': 1774846940.209418}
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DY48945') HTTP/1.1" 204 0
2026-03-30 05:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-30 05:02:20 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-30 05:02:20 [auto1.nl] INFO: Scrape type for LK58980: 2
2026-03-30 05:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bc705b-41f2-5916-9bc2-d306cbb5982c with identifier: LK58980
2026-03-30 05:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bc705b-41f2-5916-9bc2-d306cbb5982c with scrape type 2
2026-03-30 05:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00bc705b-41f2-5916-9bc2-d306cbb5982c with scrape type 2
2026-03-30 05:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00bc705b-41f2-5916-9bc2-d306cbb5982c, identifier: LK58980
2026-03-30 05:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00bc705b-41f2-5916-9bc2-d306cbb5982c with identifier: LK58980
2026-03-30 05:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00bc705b-41f2-5916-9bc2-d306cbb5982c with identifier: LK58980
2026-03-30 05:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00bc705b-41f2-5916-9bc2-d306cbb5982c with identifier: LK58980 to the API
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:23:44Z',
 'fuel_type': 'diesel',
 'id': '00bc705b-41f2-5916-9bc2-d306cbb5982c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK58980',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 272664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-27',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2009}
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-30 05:02:20 [auto1.nl] INFO: Saving data for LK58980: {'auction_closing_time': 1774884224.0, 'created_time': 1774638083.125487, 'last_price_update_time': 1774846940.733509}
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LK58980') HTTP/1.1" 204 0
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-30 05:02:20 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-30 05:02:20 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-30 05:02:20 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-30 05:02:20 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-30 05:02:20 [auto1.nl] INFO: Scrape type for FD60713: 2
2026-03-30 05:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 536b9c62-123e-5bd5-8bef-231067a49465 with identifier: FD60713
2026-03-30 05:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536b9c62-123e-5bd5-8bef-231067a49465 with scrape type 2
2026-03-30 05:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 536b9c62-123e-5bd5-8bef-231067a49465 with scrape type 2
2026-03-30 05:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 536b9c62-123e-5bd5-8bef-231067a49465, identifier: FD60713
2026-03-30 05:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 536b9c62-123e-5bd5-8bef-231067a49465 with identifier: FD60713
2026-03-30 05:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 536b9c62-123e-5bd5-8bef-231067a49465 with identifier: FD60713
2026-03-30 05:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 536b9c62-123e-5bd5-8bef-231067a49465 with identifier: FD60713 to the API
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:00:03Z',
 'fuel_type': 'diesel',
 'id': '536b9c62-123e-5bd5-8bef-231067a49465',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD60713',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 209811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-12',
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-30 05:02:21 [auto1.nl] INFO: Saving data for FD60713: {'auction_closing_time': 1774882803.0, 'created_time': 1774638163.510865, 'last_price_update_time': 1774846941.261432}
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD60713') HTTP/1.1" 204 0
2026-03-30 05:02:21 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-30 05:02:21 [auto1.nl] INFO: Scrape type for GD83498: 2
2026-03-30 05:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbe91c26-603b-5808-9c76-54017d2a9327 with identifier: GD83498
2026-03-30 05:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbe91c26-603b-5808-9c76-54017d2a9327 with scrape type 2
2026-03-30 05:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbe91c26-603b-5808-9c76-54017d2a9327 with scrape type 2
2026-03-30 05:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fbe91c26-603b-5808-9c76-54017d2a9327, identifier: GD83498
2026-03-30 05:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fbe91c26-603b-5808-9c76-54017d2a9327 with identifier: GD83498
2026-03-30 05:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fbe91c26-603b-5808-9c76-54017d2a9327 with identifier: GD83498
2026-03-30 05:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fbe91c26-603b-5808-9c76-54017d2a9327 with identifier: GD83498 to the API
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:19Z',
 'fuel_type': 'diesel',
 'id': 'fbe91c26-603b-5808-9c76-54017d2a9327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD83498',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 261007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-30',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2013}
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-30 05:02:21 [auto1.nl] INFO: Saving data for GD83498: {'auction_closing_time': 1774885279.0, 'created_time': 1774638145.971989, 'last_price_update_time': 1774846941.661421}
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD83498') HTTP/1.1" 204 0
2026-03-30 05:02:21 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-30 05:02:21 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-30 05:02:21 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-30 05:02:21 [auto1.nl] INFO: Scrape type for DH15529: 2
2026-03-30 05:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c385d0a6-353e-546d-8744-31cdaa9fdb0b with identifier: DH15529
2026-03-30 05:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c385d0a6-353e-546d-8744-31cdaa9fdb0b with scrape type 2
2026-03-30 05:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c385d0a6-353e-546d-8744-31cdaa9fdb0b with scrape type 2
2026-03-30 05:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c385d0a6-353e-546d-8744-31cdaa9fdb0b, identifier: DH15529
2026-03-30 05:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c385d0a6-353e-546d-8744-31cdaa9fdb0b with identifier: DH15529
2026-03-30 05:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c385d0a6-353e-546d-8744-31cdaa9fdb0b with identifier: DH15529
2026-03-30 05:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c385d0a6-353e-546d-8744-31cdaa9fdb0b with identifier: DH15529 to the API
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:50:35Z',
 'fuel_type': 'diesel',
 'id': 'c385d0a6-353e-546d-8744-31cdaa9fdb0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH15529',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 148686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-25',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Saving data for DH15529: {'auction_closing_time': 1774885835.0, 'created_time': 1774551644.516227, 'last_price_update_time': 1774846942.210725}
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DH15529') HTTP/1.1" 204 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Scrape type for CW75343: 2
2026-03-30 05:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acebb036-bb76-5dea-83bf-fbb110194bb1 with identifier: CW75343
2026-03-30 05:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acebb036-bb76-5dea-83bf-fbb110194bb1 with scrape type 2
2026-03-30 05:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acebb036-bb76-5dea-83bf-fbb110194bb1 with scrape type 2
2026-03-30 05:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: acebb036-bb76-5dea-83bf-fbb110194bb1, identifier: CW75343
2026-03-30 05:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: acebb036-bb76-5dea-83bf-fbb110194bb1 with identifier: CW75343
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 05:02:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: acebb036-bb76-5dea-83bf-fbb110194bb1 with identifier: CW75343
2026-03-30 05:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: acebb036-bb76-5dea-83bf-fbb110194bb1 with identifier: CW75343 to the API
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:27:43Z',
 'fuel_type': 'electro',
 'id': 'acebb036-bb76-5dea-83bf-fbb110194bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW75343',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'i4',
 'odometer': 194087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': None,
 'title': 'BMW i4 eDrive40 Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Saving data for CW75343: {'auction_closing_time': 1774884463.0, 'created_time': 1774638090.551284, 'last_price_update_time': 1774846942.806381}
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CW75343') HTTP/1.1" 204 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Scrape type for HX69861: 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-30 05:02:22 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-30 05:02:22 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-30 05:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-30 05:02:23 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-30 05:02:23 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-30 05:02:23 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-30 05:02:23 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-30 05:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-30 05:02:23 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-30 05:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:02:25 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 758 | hits on page: 40
2026-03-30 05:02:25 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-30 05:02:25 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-30 05:02:25 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-30 05:02:25 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-30 05:02:25 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-30 05:02:25 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-30 05:02:25 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-30 05:02:25 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-30 05:02:25 [auto1.nl] INFO: Scrape type for JS19868: 2
2026-03-30 05:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58ad857e-8b62-59c4-a946-083edad8258d with identifier: JS19868
2026-03-30 05:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58ad857e-8b62-59c4-a946-083edad8258d with scrape type 2
2026-03-30 05:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58ad857e-8b62-59c4-a946-083edad8258d with scrape type 2
2026-03-30 05:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58ad857e-8b62-59c4-a946-083edad8258d, identifier: JS19868
2026-03-30 05:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58ad857e-8b62-59c4-a946-083edad8258d with identifier: JS19868
2026-03-30 05:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58ad857e-8b62-59c4-a946-083edad8258d with identifier: JS19868
2026-03-30 05:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58ad857e-8b62-59c4-a946-083edad8258d with identifier: JS19868 to the API
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:44:08Z',
 'fuel_type': 'petrol',
 'id': '58ad857e-8b62-59c4-a946-083edad8258d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS19868',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 108990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2016}
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-30 05:02:25 [auto1.nl] INFO: Saving data for JS19868: {'auction_closing_time': 1774885448.0, 'created_time': 1773923122.641547, 'last_price_update_time': 1774846945.950908}
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JS19868') HTTP/1.1" 204 0
2026-03-30 05:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-30 05:02:26 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-30 05:02:26 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-30 05:02:26 [auto1.nl] INFO: Scrape type for MF68511: 2
2026-03-30 05:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74124519-82cc-5793-94d8-8bd98d784836 with identifier: MF68511
2026-03-30 05:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74124519-82cc-5793-94d8-8bd98d784836 with scrape type 2
2026-03-30 05:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74124519-82cc-5793-94d8-8bd98d784836 with scrape type 2
2026-03-30 05:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74124519-82cc-5793-94d8-8bd98d784836, identifier: MF68511
2026-03-30 05:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74124519-82cc-5793-94d8-8bd98d784836 with identifier: MF68511
2026-03-30 05:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74124519-82cc-5793-94d8-8bd98d784836 with identifier: MF68511
2026-03-30 05:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74124519-82cc-5793-94d8-8bd98d784836 with identifier: MF68511 to the API
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:07Z',
 'fuel_type': 'diesel',
 'id': '74124519-82cc-5793-94d8-8bd98d784836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF68511',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 254893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-30 05:02:26 [auto1.nl] INFO: Saving data for MF68511: {'auction_closing_time': 1774886107.0, 'created_time': 1774551670.282208, 'last_price_update_time': 1774846946.529261}
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MF68511') HTTP/1.1" 204 0
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-30 05:02:26 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-30 05:02:26 [auto1.nl] INFO: Scrape type for HZ82321: 2
2026-03-30 05:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ead0878-2625-5a5d-8123-a3a6ee712540 with identifier: HZ82321
2026-03-30 05:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ead0878-2625-5a5d-8123-a3a6ee712540 with scrape type 2
2026-03-30 05:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ead0878-2625-5a5d-8123-a3a6ee712540 with scrape type 2
2026-03-30 05:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ead0878-2625-5a5d-8123-a3a6ee712540, identifier: HZ82321
2026-03-30 05:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ead0878-2625-5a5d-8123-a3a6ee712540 with identifier: HZ82321
2026-03-30 05:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ead0878-2625-5a5d-8123-a3a6ee712540 with identifier: HZ82321
2026-03-30 05:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ead0878-2625-5a5d-8123-a3a6ee712540 with identifier: HZ82321 to the API
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:58:16Z',
 'fuel_type': 'diesel',
 'id': '4ead0878-2625-5a5d-8123-a3a6ee712540',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ82321',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 174390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'BMW 3er 320d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-30 05:02:26 [auto1.nl] INFO: Saving data for HZ82321: {'auction_closing_time': 1774886296.0, 'created_time': 1774638099.645311, 'last_price_update_time': 1774846946.95943}
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HZ82321') HTTP/1.1" 204 0
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-30 05:02:26 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-30 05:02:26 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-30 05:02:27 [auto1.nl] INFO: Scrape type for FB74313: 2
2026-03-30 05:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ad33247-a60d-5667-8c2c-b5b47235c678 with identifier: FB74313
2026-03-30 05:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ad33247-a60d-5667-8c2c-b5b47235c678 with scrape type 2
2026-03-30 05:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ad33247-a60d-5667-8c2c-b5b47235c678 with scrape type 2
2026-03-30 05:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1ad33247-a60d-5667-8c2c-b5b47235c678, identifier: FB74313
2026-03-30 05:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1ad33247-a60d-5667-8c2c-b5b47235c678 with identifier: FB74313
2026-03-30 05:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1ad33247-a60d-5667-8c2c-b5b47235c678 with identifier: FB74313
2026-03-30 05:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1ad33247-a60d-5667-8c2c-b5b47235c678 with identifier: FB74313 to the API
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:23Z',
 'fuel_type': 'petrol',
 'id': '1ad33247-a60d-5667-8c2c-b5b47235c678',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB74313',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 134242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-02',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2018}
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-30 05:02:27 [auto1.nl] INFO: Saving data for FB74313: {'auction_closing_time': 1774885043.0, 'created_time': 1773133520.509048, 'last_price_update_time': 1774846947.404344}
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB74313') HTTP/1.1" 204 0
2026-03-30 05:02:27 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-30 05:02:27 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-30 05:02:27 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-30 05:02:27 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-30 05:02:27 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-30 05:02:27 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-30 05:02:27 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-30 05:02:27 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-30 05:02:27 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-30 05:02:27 [auto1.nl] INFO: Scrape type for LL90951: 2
2026-03-30 05:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66435a6-23a3-577c-9ed9-8183636e6060 with identifier: LL90951
2026-03-30 05:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66435a6-23a3-577c-9ed9-8183636e6060 with scrape type 2
2026-03-30 05:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d66435a6-23a3-577c-9ed9-8183636e6060 with scrape type 2
2026-03-30 05:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d66435a6-23a3-577c-9ed9-8183636e6060, identifier: LL90951
2026-03-30 05:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d66435a6-23a3-577c-9ed9-8183636e6060 with identifier: LL90951
2026-03-30 05:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d66435a6-23a3-577c-9ed9-8183636e6060 with identifier: LL90951
2026-03-30 05:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d66435a6-23a3-577c-9ed9-8183636e6060 with identifier: LL90951 to the API
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'petrol',
 'id': 'd66435a6-23a3-577c-9ed9-8183636e6060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL90951',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 247575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-06',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 3.3 V6 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2007}
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-30 05:02:27 [auto1.nl] INFO: Saving data for LL90951: {'auction_closing_time': 1774884351.0, 'created_time': 1774638066.668456, 'last_price_update_time': 1774846947.997345}
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LL90951') HTTP/1.1" 204 0
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-30 05:02:28 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-30 05:02:28 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-30 05:02:28 [auto1.nl] INFO: Scrape type for WC04014: 2
2026-03-30 05:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df82903a-4b4d-55ca-88fd-43bf61db3cb7 with identifier: WC04014
2026-03-30 05:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df82903a-4b4d-55ca-88fd-43bf61db3cb7 with scrape type 2
2026-03-30 05:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df82903a-4b4d-55ca-88fd-43bf61db3cb7 with scrape type 2
2026-03-30 05:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: df82903a-4b4d-55ca-88fd-43bf61db3cb7, identifier: WC04014
2026-03-30 05:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: df82903a-4b4d-55ca-88fd-43bf61db3cb7 with identifier: WC04014
2026-03-30 05:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: df82903a-4b4d-55ca-88fd-43bf61db3cb7 with identifier: WC04014
2026-03-30 05:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: df82903a-4b4d-55ca-88fd-43bf61db3cb7 with identifier: WC04014 to the API
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:13:42Z',
 'fuel_type': 'diesel',
 'id': 'df82903a-4b4d-55ca-88fd-43bf61db3cb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC04014',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 196011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-11',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-30 05:02:28 [auto1.nl] INFO: Saving data for WC04014: {'auction_closing_time': 1774883622.0, 'created_time': 1774638052.87559, 'last_price_update_time': 1774846948.720241}
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC04014') HTTP/1.1" 204 0
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-30 05:02:28 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-30 05:02:28 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-30 05:02:28 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-30 05:02:28 [auto1.nl] INFO: Scrape type for ZD81791: 2
2026-03-30 05:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162305ee-27dd-5d3b-9ead-f25e4237fba5 with identifier: ZD81791
2026-03-30 05:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162305ee-27dd-5d3b-9ead-f25e4237fba5 with scrape type 2
2026-03-30 05:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162305ee-27dd-5d3b-9ead-f25e4237fba5 with scrape type 2
2026-03-30 05:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 162305ee-27dd-5d3b-9ead-f25e4237fba5, identifier: ZD81791
2026-03-30 05:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 162305ee-27dd-5d3b-9ead-f25e4237fba5 with identifier: ZD81791
2026-03-30 05:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 162305ee-27dd-5d3b-9ead-f25e4237fba5 with identifier: ZD81791
2026-03-30 05:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 162305ee-27dd-5d3b-9ead-f25e4237fba5 with identifier: ZD81791 to the API
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:02:21Z',
 'fuel_type': 'petrol',
 'id': '162305ee-27dd-5d3b-9ead-f25e4237fba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD81791',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 118263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-20',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-30 05:02:29 [auto1.nl] INFO: Saving data for ZD81791: {'auction_closing_time': 1774882941.0, 'created_time': 1774638129.291646, 'last_price_update_time': 1774846949.308932}
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZD81791') HTTP/1.1" 204 0
2026-03-30 05:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:02:29 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 758 | hits on page: 40
2026-03-30 05:02:29 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-30 05:02:29 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-30 05:02:29 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-30 05:02:29 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-30 05:02:29 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-30 05:02:29 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-30 05:02:29 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-30 05:02:29 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-30 05:02:29 [auto1.nl] INFO: Scrape type for PZ45874: 2
2026-03-30 05:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with identifier: PZ45874
2026-03-30 05:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with scrape type 2
2026-03-30 05:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with scrape type 2
2026-03-30 05:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875, identifier: PZ45874
2026-03-30 05:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with identifier: PZ45874
2026-03-30 05:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with identifier: PZ45874
2026-03-30 05:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with identifier: PZ45874 to the API
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:53:21Z',
 'fuel_type': 'hybrid',
 'id': 'ac791dc7-c36c-5b6a-adc2-c53dbf6e5875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ45874',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 113916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-30 05:02:29 [auto1.nl] INFO: Saving data for PZ45874: {'auction_closing_time': 1774886001.0, 'created_time': 1774551640.605072, 'last_price_update_time': 1774846949.854521}
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PZ45874') HTTP/1.1" 204 0
2026-03-30 05:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:02:29 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-30 05:02:29 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-30 05:02:29 [auto1.nl] INFO: Scrape type for VJ86590: 2
2026-03-30 05:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450b030e-a049-531c-a7a0-9d8cd0757cf2 with identifier: VJ86590
2026-03-30 05:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450b030e-a049-531c-a7a0-9d8cd0757cf2 with scrape type 2
2026-03-30 05:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 450b030e-a049-531c-a7a0-9d8cd0757cf2 with scrape type 2
2026-03-30 05:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 450b030e-a049-531c-a7a0-9d8cd0757cf2, identifier: VJ86590
2026-03-30 05:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 450b030e-a049-531c-a7a0-9d8cd0757cf2 with identifier: VJ86590
2026-03-30 05:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 450b030e-a049-531c-a7a0-9d8cd0757cf2 with identifier: VJ86590
2026-03-30 05:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 450b030e-a049-531c-a7a0-9d8cd0757cf2 with identifier: VJ86590 to the API
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:44:33Z',
 'fuel_type': 'petrol',
 'id': '450b030e-a049-531c-a7a0-9d8cd0757cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ86590',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 200383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2010}
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-30 05:02:30 [auto1.nl] INFO: Saving data for VJ86590: {'auction_closing_time': 1774885473.0, 'created_time': 1774638151.550385, 'last_price_update_time': 1774846950.363293}
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VJ86590') HTTP/1.1" 204 0
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-30 05:02:30 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-30 05:02:30 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-30 05:02:30 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-30 05:02:30 [auto1.nl] INFO: Scrape type for UV82075: 2
2026-03-30 05:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e955c13-67e6-54fd-9208-763665e08e97 with identifier: UV82075
2026-03-30 05:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e955c13-67e6-54fd-9208-763665e08e97 with scrape type 2
2026-03-30 05:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e955c13-67e6-54fd-9208-763665e08e97 with scrape type 2
2026-03-30 05:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e955c13-67e6-54fd-9208-763665e08e97, identifier: UV82075
2026-03-30 05:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e955c13-67e6-54fd-9208-763665e08e97 with identifier: UV82075
2026-03-30 05:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e955c13-67e6-54fd-9208-763665e08e97 with identifier: UV82075
2026-03-30 05:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e955c13-67e6-54fd-9208-763665e08e97 with identifier: UV82075 to the API
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:22:21Z',
 'fuel_type': 'petrol',
 'id': '1e955c13-67e6-54fd-9208-763665e08e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV82075',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 106913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-26',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.2 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2014}
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-30 05:02:30 [auto1.nl] INFO: Saving data for UV82075: {'auction_closing_time': 1774884141.0, 'created_time': 1774638141.328508, 'last_price_update_time': 1774846950.840925}
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UV82075') HTTP/1.1" 204 0
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-30 05:02:30 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-30 05:02:30 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-30 05:02:30 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-30 05:02:31 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-30 05:02:31 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-30 05:02:31 [auto1.nl] INFO: Scrape type for HB03885: 2
2026-03-30 05:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc4ed060-3569-5d5a-b837-710f96c36a93 with identifier: HB03885
2026-03-30 05:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc4ed060-3569-5d5a-b837-710f96c36a93 with scrape type 2
2026-03-30 05:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc4ed060-3569-5d5a-b837-710f96c36a93 with scrape type 2
2026-03-30 05:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cc4ed060-3569-5d5a-b837-710f96c36a93, identifier: HB03885
2026-03-30 05:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cc4ed060-3569-5d5a-b837-710f96c36a93 with identifier: HB03885
2026-03-30 05:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cc4ed060-3569-5d5a-b837-710f96c36a93 with identifier: HB03885
2026-03-30 05:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cc4ed060-3569-5d5a-b837-710f96c36a93 with identifier: HB03885 to the API
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:21:34Z',
 'fuel_type': 'petrol',
 'id': 'cc4ed060-3569-5d5a-b837-710f96c36a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB03885',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 132143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2017}
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-30 05:02:31 [auto1.nl] INFO: Saving data for HB03885: {'auction_closing_time': 1774884094.0, 'created_time': 1774638152.938112, 'last_price_update_time': 1774846951.715602}
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HB03885') HTTP/1.1" 204 0
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-30 05:02:31 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-30 05:02:31 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-30 05:02:31 [auto1.nl] INFO: Scrape type for JX76832: 2
2026-03-30 05:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4698296e-4baf-5297-8d4d-d578ff5edd95 with identifier: JX76832
2026-03-30 05:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4698296e-4baf-5297-8d4d-d578ff5edd95 with scrape type 2
2026-03-30 05:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4698296e-4baf-5297-8d4d-d578ff5edd95 with scrape type 2
2026-03-30 05:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4698296e-4baf-5297-8d4d-d578ff5edd95, identifier: JX76832
2026-03-30 05:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4698296e-4baf-5297-8d4d-d578ff5edd95 with identifier: JX76832
2026-03-30 05:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4698296e-4baf-5297-8d4d-d578ff5edd95 with identifier: JX76832
2026-03-30 05:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4698296e-4baf-5297-8d4d-d578ff5edd95 with identifier: JX76832 to the API
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:46Z',
 'fuel_type': 'petrol',
 'id': '4698296e-4baf-5297-8d4d-d578ff5edd95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX76832',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 136053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Peugeot Partner 1.2 PureTech Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2016}
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-30 05:02:32 [auto1.nl] INFO: Saving data for JX76832: {'auction_closing_time': 1774883326.0, 'created_time': 1774638064.61472, 'last_price_update_time': 1774846952.220586}
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JX76832') HTTP/1.1" 204 0
2026-03-30 05:02:32 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-30 05:02:32 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-30 05:02:32 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-30 05:02:32 [auto1.nl] INFO: Scrape type for KB67971: 2
2026-03-30 05:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e425e933-a83a-53b9-b039-9ffefbf5d9b2 with identifier: KB67971
2026-03-30 05:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e425e933-a83a-53b9-b039-9ffefbf5d9b2 with scrape type 2
2026-03-30 05:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e425e933-a83a-53b9-b039-9ffefbf5d9b2 with scrape type 2
2026-03-30 05:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e425e933-a83a-53b9-b039-9ffefbf5d9b2, identifier: KB67971
2026-03-30 05:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e425e933-a83a-53b9-b039-9ffefbf5d9b2 with identifier: KB67971
2026-03-30 05:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e425e933-a83a-53b9-b039-9ffefbf5d9b2 with identifier: KB67971
2026-03-30 05:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e425e933-a83a-53b9-b039-9ffefbf5d9b2 with identifier: KB67971 to the API
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:42:51Z',
 'fuel_type': 'petrol',
 'id': 'e425e933-a83a-53b9-b039-9ffefbf5d9b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB67971',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 155250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-03',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-30 05:02:32 [auto1.nl] INFO: Saving data for KB67971: {'auction_closing_time': 1774885371.0, 'created_time': 1773921665.69155, 'last_price_update_time': 1774846952.669963}
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB67971') HTTP/1.1" 204 0
2026-03-30 05:02:32 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-30 05:02:32 [auto1.nl] INFO: Scrape type for XW28642: 0
2026-03-30 05:02:32 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-30 05:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:02:33 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 758 | hits on page: 40
2026-03-30 05:02:33 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-30 05:02:33 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-30 05:02:33 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-30 05:02:33 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-30 05:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-30 05:02:33 [auto1.nl] INFO: Scrape type for RF39867: 2
2026-03-30 05:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with identifier: RF39867
2026-03-30 05:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with scrape type 2
2026-03-30 05:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with scrape type 2
2026-03-30 05:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07, identifier: RF39867
2026-03-30 05:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with identifier: RF39867
2026-03-30 05:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with identifier: RF39867
2026-03-30 05:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with identifier: RF39867 to the API
2026-03-30 05:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:21Z',
 'fuel_type': 'petrol',
 'id': '56a21b27-cfc0-5a40-99b1-3ec63ac21b07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF39867',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 77053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Saving data for RF39867: {'auction_closing_time': 1774884321.0, 'created_time': 1774638147.717467, 'last_price_update_time': 1774846954.123197}
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF39867') HTTP/1.1" 204 0
2026-03-30 05:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Scrape type for EE94160: 2
2026-03-30 05:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with identifier: EE94160
2026-03-30 05:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with scrape type 2
2026-03-30 05:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with scrape type 2
2026-03-30 05:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da, identifier: EE94160
2026-03-30 05:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with identifier: EE94160
2026-03-30 05:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with identifier: EE94160
2026-03-30 05:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with identifier: EE94160 to the API
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:51:09Z',
 'fuel_type': 'petrol',
 'id': '1abb55d4-95e6-5bd5-9857-4dd48e1f08da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE94160',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 222625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency AMG Sport',
 'transmission': 'manual',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2013}
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Saving data for EE94160: {'auction_closing_time': 1774885869.0, 'created_time': 1773837093.192047, 'last_price_update_time': 1774846954.636127}
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EE94160') HTTP/1.1" 204 0
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Scrape type for UF74705: 0
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-30 05:02:34 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-30 05:02:34 [auto1.nl] INFO: Scrape type for SA72680: 2
2026-03-30 05:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with identifier: SA72680
2026-03-30 05:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with scrape type 2
2026-03-30 05:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with scrape type 2
2026-03-30 05:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9, identifier: SA72680
2026-03-30 05:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with identifier: SA72680
2026-03-30 05:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with identifier: SA72680
2026-03-30 05:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with identifier: SA72680 to the API
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'petrol',
 'id': 'd9f35645-1fa8-580b-8c1b-d7d0b6ef23e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA72680',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 179677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Fiat Punto 0.9 My Punto',
 'transmission': 'manual',
 'trim': 'My',
 'year': 2014}
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Saving data for SA72680: {'auction_closing_time': 1774884468.0, 'created_time': 1774638081.74115, 'last_price_update_time': 1774846955.159493}
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA72680') HTTP/1.1" 204 0
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Scrape type for MY24327: 2
2026-03-30 05:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a054939f-0e95-5617-ab4b-575626c6e28e with identifier: MY24327
2026-03-30 05:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a054939f-0e95-5617-ab4b-575626c6e28e with scrape type 2
2026-03-30 05:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a054939f-0e95-5617-ab4b-575626c6e28e with scrape type 2
2026-03-30 05:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a054939f-0e95-5617-ab4b-575626c6e28e, identifier: MY24327
2026-03-30 05:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a054939f-0e95-5617-ab4b-575626c6e28e with identifier: MY24327
2026-03-30 05:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a054939f-0e95-5617-ab4b-575626c6e28e with identifier: MY24327
2026-03-30 05:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a054939f-0e95-5617-ab4b-575626c6e28e with identifier: MY24327 to the API
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:41:47Z',
 'fuel_type': 'petrol',
 'id': 'a054939f-0e95-5617-ab4b-575626c6e28e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY24327',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 280833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-10',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Saving data for MY24327: {'auction_closing_time': 1774885307.0, 'created_time': 1773343192.548245, 'last_price_update_time': 1774846955.629489}
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MY24327') HTTP/1.1" 204 0
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-30 05:02:35 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-30 05:02:35 [auto1.nl] INFO: Scrape type for VU71978: 2
2026-03-30 05:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb886aed-1167-53f0-9d2f-9f5f3a00741d with identifier: VU71978
2026-03-30 05:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb886aed-1167-53f0-9d2f-9f5f3a00741d with scrape type 2
2026-03-30 05:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb886aed-1167-53f0-9d2f-9f5f3a00741d with scrape type 2
2026-03-30 05:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fb886aed-1167-53f0-9d2f-9f5f3a00741d, identifier: VU71978
2026-03-30 05:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fb886aed-1167-53f0-9d2f-9f5f3a00741d with identifier: VU71978
2026-03-30 05:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fb886aed-1167-53f0-9d2f-9f5f3a00741d with identifier: VU71978
2026-03-30 05:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fb886aed-1167-53f0-9d2f-9f5f3a00741d with identifier: VU71978 to the API
2026-03-30 05:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:23:31Z',
 'fuel_type': 'petrol',
 'id': 'fb886aed-1167-53f0-9d2f-9f5f3a00741d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU71978',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 211988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-30 05:02:36 [auto1.nl] INFO: Saving data for VU71978: {'auction_closing_time': 1774884211.0, 'created_time': 1774638176.784597, 'last_price_update_time': 1774846956.120711}
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VU71978') HTTP/1.1" 204 0
2026-03-30 05:02:36 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-30 05:02:36 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-30 05:02:36 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-30 05:02:36 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-30 05:02:36 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-30 05:02:36 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-30 05:02:36 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-30 05:02:36 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-30 05:02:36 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-30 05:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:02:51 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 758 | hits on page: 40
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-30 05:02:51 [auto1.nl] INFO: Scrape type for AM42063: 0
2026-03-30 05:02:51 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-30 05:02:52 [auto1.nl] INFO: Scrape type for VV88142: 2
2026-03-30 05:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 410344a6-2d6d-55f8-b230-0fc2a1103eee with identifier: VV88142
2026-03-30 05:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 410344a6-2d6d-55f8-b230-0fc2a1103eee with scrape type 2
2026-03-30 05:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 410344a6-2d6d-55f8-b230-0fc2a1103eee with scrape type 2
2026-03-30 05:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 410344a6-2d6d-55f8-b230-0fc2a1103eee, identifier: VV88142
2026-03-30 05:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 410344a6-2d6d-55f8-b230-0fc2a1103eee with identifier: VV88142
2026-03-30 05:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 410344a6-2d6d-55f8-b230-0fc2a1103eee with identifier: VV88142
2026-03-30 05:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 410344a6-2d6d-55f8-b230-0fc2a1103eee with identifier: VV88142 to the API
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:11:02Z',
 'fuel_type': 'petrol',
 'id': '410344a6-2d6d-55f8-b230-0fc2a1103eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV88142',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 163917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-30 05:02:52 [auto1.nl] INFO: Saving data for VV88142: {'auction_closing_time': 1774883462.0, 'created_time': 1774551638.040584, 'last_price_update_time': 1774846972.444842}
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VV88142') HTTP/1.1" 204 0
2026-03-30 05:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:02:52 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-30 05:02:52 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-30 05:02:52 [auto1.nl] INFO: Scrape type for TC30391: 2
2026-03-30 05:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 769ddca8-1daa-5c77-a985-a925d69465af with identifier: TC30391
2026-03-30 05:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769ddca8-1daa-5c77-a985-a925d69465af with scrape type 2
2026-03-30 05:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 769ddca8-1daa-5c77-a985-a925d69465af with scrape type 2
2026-03-30 05:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 769ddca8-1daa-5c77-a985-a925d69465af, identifier: TC30391
2026-03-30 05:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 769ddca8-1daa-5c77-a985-a925d69465af with identifier: TC30391
2026-03-30 05:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 769ddca8-1daa-5c77-a985-a925d69465af with identifier: TC30391
2026-03-30 05:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 769ddca8-1daa-5c77-a985-a925d69465af with identifier: TC30391 to the API
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:31:26Z',
 'fuel_type': 'petrol',
 'id': '769ddca8-1daa-5c77-a985-a925d69465af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC30391',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 181704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-12',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-30 05:02:52 [auto1.nl] INFO: Saving data for TC30391: {'auction_closing_time': 1774884686.0, 'created_time': 1773947231.237206, 'last_price_update_time': 1774846972.998443}
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC30391') HTTP/1.1" 204 0
2026-03-30 05:02:53 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-30 05:02:53 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-30 05:02:53 [auto1.nl] INFO: Scrape type for KV69786: 2
2026-03-30 05:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 134bdab2-9013-5964-9b6d-8bc345995384 with identifier: KV69786
2026-03-30 05:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 134bdab2-9013-5964-9b6d-8bc345995384 with scrape type 2
2026-03-30 05:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 134bdab2-9013-5964-9b6d-8bc345995384 with scrape type 2
2026-03-30 05:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 134bdab2-9013-5964-9b6d-8bc345995384, identifier: KV69786
2026-03-30 05:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 134bdab2-9013-5964-9b6d-8bc345995384 with identifier: KV69786
2026-03-30 05:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 134bdab2-9013-5964-9b6d-8bc345995384 with identifier: KV69786
2026-03-30 05:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 134bdab2-9013-5964-9b6d-8bc345995384 with identifier: KV69786 to the API
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:46:34Z',
 'fuel_type': 'petrol',
 'id': '134bdab2-9013-5964-9b6d-8bc345995384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV69786',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 104895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Turbo Color Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Color Edition ecoFlex',
 'year': 2015}
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-30 05:02:53 [auto1.nl] INFO: Saving data for KV69786: {'auction_closing_time': 1774885594.0, 'created_time': 1774638163.104452, 'last_price_update_time': 1774846973.422094}
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV69786') HTTP/1.1" 204 0
2026-03-30 05:02:53 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-30 05:02:53 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-30 05:02:53 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-30 05:02:53 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-30 05:02:53 [auto1.nl] INFO: Scrape type for EM66057: 2
2026-03-30 05:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d19fbe2-b437-515c-8662-fc6be36de70f with identifier: EM66057
2026-03-30 05:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d19fbe2-b437-515c-8662-fc6be36de70f with scrape type 2
2026-03-30 05:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d19fbe2-b437-515c-8662-fc6be36de70f with scrape type 2
2026-03-30 05:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d19fbe2-b437-515c-8662-fc6be36de70f, identifier: EM66057
2026-03-30 05:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d19fbe2-b437-515c-8662-fc6be36de70f with identifier: EM66057
2026-03-30 05:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d19fbe2-b437-515c-8662-fc6be36de70f with identifier: EM66057
2026-03-30 05:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d19fbe2-b437-515c-8662-fc6be36de70f with identifier: EM66057 to the API
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:18:11Z',
 'fuel_type': 'petrol',
 'id': '7d19fbe2-b437-515c-8662-fc6be36de70f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM66057',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 218782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2013}
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-30 05:02:53 [auto1.nl] INFO: Saving data for EM66057: {'auction_closing_time': 1774883891.0, 'created_time': 1774638109.348845, 'last_price_update_time': 1774846973.842189}
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM66057') HTTP/1.1" 204 0
2026-03-30 05:02:53 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-30 05:02:53 [auto1.nl] INFO: Scrape type for AL57491: 2
2026-03-30 05:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39141fa5-6e43-5c84-aaab-2419efc17585 with identifier: AL57491
2026-03-30 05:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39141fa5-6e43-5c84-aaab-2419efc17585 with scrape type 2
2026-03-30 05:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39141fa5-6e43-5c84-aaab-2419efc17585 with scrape type 2
2026-03-30 05:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 39141fa5-6e43-5c84-aaab-2419efc17585, identifier: AL57491
2026-03-30 05:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 39141fa5-6e43-5c84-aaab-2419efc17585 with identifier: AL57491
2026-03-30 05:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 39141fa5-6e43-5c84-aaab-2419efc17585 with identifier: AL57491
2026-03-30 05:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 39141fa5-6e43-5c84-aaab-2419efc17585 with identifier: AL57491 to the API
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:04:00Z',
 'fuel_type': 'petrol',
 'id': '39141fa5-6e43-5c84-aaab-2419efc17585',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL57491',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 200297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-30 05:02:54 [auto1.nl] INFO: Saving data for AL57491: {'auction_closing_time': 1774883040.0, 'created_time': 1774638150.321564, 'last_price_update_time': 1774846974.238698}
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AL57491') HTTP/1.1" 204 0
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-30 05:02:54 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-30 05:02:54 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-30 05:02:54 [auto1.nl] INFO: Scrape type for ML76723: 2
2026-03-30 05:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with identifier: ML76723
2026-03-30 05:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with scrape type 2
2026-03-30 05:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with scrape type 2
2026-03-30 05:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e, identifier: ML76723
2026-03-30 05:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with identifier: ML76723
2026-03-30 05:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with identifier: ML76723
2026-03-30 05:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with identifier: ML76723 to the API
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:19:35Z',
 'fuel_type': 'petrol',
 'id': '3cb501d5-6e9e-578c-a21d-18164b4c2f0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML76723',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 208462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-28',
 'seller_name': None,
 'title': 'Fiat Bravo 1.4 Turbo MultiAir T. Emotion',
 'transmission': 'manual',
 'trim': 'MultiAir T. Emotion',
 'year': 2010}
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-30 05:02:54 [auto1.nl] INFO: Saving data for ML76723: {'auction_closing_time': 1774883975.0, 'created_time': 1774638143.772368, 'last_price_update_time': 1774846974.683486}
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML76723') HTTP/1.1" 204 0
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-30 05:02:54 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-30 05:02:54 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-30 05:02:54 [auto1.nl] INFO: Scrape type for JN86544: 2
2026-03-30 05:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7e7017-7079-5943-8946-ee9d2f995822 with identifier: JN86544
2026-03-30 05:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7e7017-7079-5943-8946-ee9d2f995822 with scrape type 2
2026-03-30 05:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f7e7017-7079-5943-8946-ee9d2f995822 with scrape type 2
2026-03-30 05:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4f7e7017-7079-5943-8946-ee9d2f995822, identifier: JN86544
2026-03-30 05:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4f7e7017-7079-5943-8946-ee9d2f995822 with identifier: JN86544
2026-03-30 05:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4f7e7017-7079-5943-8946-ee9d2f995822 with identifier: JN86544
2026-03-30 05:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4f7e7017-7079-5943-8946-ee9d2f995822 with identifier: JN86544 to the API
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:36:25Z',
 'fuel_type': 'petrol',
 'id': '4f7e7017-7079-5943-8946-ee9d2f995822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN86544',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 222355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-27',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2016}
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-30 05:02:55 [auto1.nl] INFO: Saving data for JN86544: {'auction_closing_time': 1774884985.0, 'created_time': 1774638173.655118, 'last_price_update_time': 1774846975.248875}
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JN86544') HTTP/1.1" 204 0
2026-03-30 05:02:55 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-30 05:02:55 [auto1.nl] INFO: Scrape type for GY00070: 2
2026-03-30 05:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dfe957d-07da-58b3-b64d-f237cbadc483 with identifier: GY00070
2026-03-30 05:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfe957d-07da-58b3-b64d-f237cbadc483 with scrape type 2
2026-03-30 05:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dfe957d-07da-58b3-b64d-f237cbadc483 with scrape type 2
2026-03-30 05:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2dfe957d-07da-58b3-b64d-f237cbadc483, identifier: GY00070
2026-03-30 05:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2dfe957d-07da-58b3-b64d-f237cbadc483 with identifier: GY00070
2026-03-30 05:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2dfe957d-07da-58b3-b64d-f237cbadc483 with identifier: GY00070
2026-03-30 05:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2dfe957d-07da-58b3-b64d-f237cbadc483 with identifier: GY00070 to the API
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:01:25Z',
 'fuel_type': 'petrol',
 'id': '2dfe957d-07da-58b3-b64d-f237cbadc483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY00070',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 156020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-26',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Inform',
 'transmission': 'automatic',
 'trim': 'Inform',
 'year': 2007}
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-30 05:02:55 [auto1.nl] INFO: Saving data for GY00070: {'auction_closing_time': 1774882885.0, 'created_time': 1774638144.128975, 'last_price_update_time': 1774846975.647986}
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY00070') HTTP/1.1" 204 0
2026-03-30 05:02:55 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-30 05:02:55 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-30 05:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:02:58 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 758 | hits on page: 40
2026-03-30 05:02:58 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-30 05:02:58 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-30 05:02:58 [auto1.nl] INFO: Scrape type for HZ03058: 2
2026-03-30 05:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 988cee1f-30bd-5944-9256-9363d70e1856 with identifier: HZ03058
2026-03-30 05:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 988cee1f-30bd-5944-9256-9363d70e1856 with scrape type 2
2026-03-30 05:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 988cee1f-30bd-5944-9256-9363d70e1856 with scrape type 2
2026-03-30 05:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 988cee1f-30bd-5944-9256-9363d70e1856, identifier: HZ03058
2026-03-30 05:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 988cee1f-30bd-5944-9256-9363d70e1856 with identifier: HZ03058
2026-03-30 05:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 988cee1f-30bd-5944-9256-9363d70e1856 with identifier: HZ03058
2026-03-30 05:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 988cee1f-30bd-5944-9256-9363d70e1856 with identifier: HZ03058 to the API
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:02Z',
 'fuel_type': 'petrol',
 'id': '988cee1f-30bd-5944-9256-9363d70e1856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ03058',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 73629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-30',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Version S',
 'transmission': 'automatic',
 'trim': 'Version S',
 'year': 2019}
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-30 05:02:58 [auto1.nl] INFO: Saving data for HZ03058: {'auction_closing_time': 1774883282.0, 'created_time': 1773921662.480183, 'last_price_update_time': 1774846978.908751}
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HZ03058') HTTP/1.1" 204 0
2026-03-30 05:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:02:58 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-30 05:02:58 [auto1.nl] INFO: Scrape type for FA84913: 2
2026-03-30 05:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e654c2bc-444b-5afc-859c-22492f4348ae with identifier: FA84913
2026-03-30 05:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e654c2bc-444b-5afc-859c-22492f4348ae with scrape type 2
2026-03-30 05:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e654c2bc-444b-5afc-859c-22492f4348ae with scrape type 2
2026-03-30 05:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e654c2bc-444b-5afc-859c-22492f4348ae, identifier: FA84913
2026-03-30 05:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e654c2bc-444b-5afc-859c-22492f4348ae with identifier: FA84913
2026-03-30 05:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e654c2bc-444b-5afc-859c-22492f4348ae with identifier: FA84913
2026-03-30 05:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e654c2bc-444b-5afc-859c-22492f4348ae with identifier: FA84913 to the API
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:52:54Z',
 'fuel_type': 'petrol',
 'id': 'e654c2bc-444b-5afc-859c-22492f4348ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA84913',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 144149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2016}
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Saving data for FA84913: {'auction_closing_time': 1774885974.0, 'created_time': 1773342321.860622, 'last_price_update_time': 1774846979.383478}
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FA84913') HTTP/1.1" 204 0
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Scrape type for DD65196: 2
2026-03-30 05:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beeb97f8-8f52-56aa-9079-b6f8934586d5 with identifier: DD65196
2026-03-30 05:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beeb97f8-8f52-56aa-9079-b6f8934586d5 with scrape type 2
2026-03-30 05:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beeb97f8-8f52-56aa-9079-b6f8934586d5 with scrape type 2
2026-03-30 05:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: beeb97f8-8f52-56aa-9079-b6f8934586d5, identifier: DD65196
2026-03-30 05:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: beeb97f8-8f52-56aa-9079-b6f8934586d5 with identifier: DD65196
2026-03-30 05:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: beeb97f8-8f52-56aa-9079-b6f8934586d5 with identifier: DD65196
2026-03-30 05:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: beeb97f8-8f52-56aa-9079-b6f8934586d5 with identifier: DD65196 to the API
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:33:13Z',
 'fuel_type': 'petrol',
 'id': 'beeb97f8-8f52-56aa-9079-b6f8934586d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD65196',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 256696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-02',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Saving data for DD65196: {'auction_closing_time': 1774884793.0, 'created_time': 1774638144.475591, 'last_price_update_time': 1774846979.768479}
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DD65196') HTTP/1.1" 204 0
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-30 05:02:59 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-30 05:02:59 [auto1.nl] INFO: Scrape type for PP40573: 2
2026-03-30 05:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec35913-cfa1-5c31-a236-762cf9f06c54 with identifier: PP40573
2026-03-30 05:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec35913-cfa1-5c31-a236-762cf9f06c54 with scrape type 2
2026-03-30 05:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ec35913-cfa1-5c31-a236-762cf9f06c54 with scrape type 2
2026-03-30 05:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ec35913-cfa1-5c31-a236-762cf9f06c54, identifier: PP40573
2026-03-30 05:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ec35913-cfa1-5c31-a236-762cf9f06c54 with identifier: PP40573
2026-03-30 05:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ec35913-cfa1-5c31-a236-762cf9f06c54 with identifier: PP40573
2026-03-30 05:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ec35913-cfa1-5c31-a236-762cf9f06c54 with identifier: PP40573 to the API
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-30T15:37:25Z',
 'fuel_type': 'petrol',
 'id': '2ec35913-cfa1-5c31-a236-762cf9f06c54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP40573',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 298248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Business Plus',
 'transmission': 'automatic',
 'trim': 'Business Plus',
 'year': 2019}
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-30 05:03:00 [auto1.nl] INFO: Saving data for PP40573: {'auction_closing_time': 1774885045.0, 'created_time': 1773232423.460622, 'last_price_update_time': 1774846980.455339}
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PP40573') HTTP/1.1" 204 0
2026-03-30 05:03:00 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-30 05:03:00 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-30 05:03:00 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-30 05:03:00 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-30 05:03:00 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-30 05:03:00 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-30 05:03:00 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-30 05:03:00 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-30 05:03:00 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-30 05:03:00 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-30 05:03:00 [auto1.nl] INFO: Scrape type for ZR26013: 2
2026-03-30 05:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ffd493-8801-52f6-a59a-e0398ce28620 with identifier: ZR26013
2026-03-30 05:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ffd493-8801-52f6-a59a-e0398ce28620 with scrape type 2
2026-03-30 05:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ffd493-8801-52f6-a59a-e0398ce28620 with scrape type 2
2026-03-30 05:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 25ffd493-8801-52f6-a59a-e0398ce28620, identifier: ZR26013
2026-03-30 05:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 25ffd493-8801-52f6-a59a-e0398ce28620 with identifier: ZR26013
2026-03-30 05:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 25ffd493-8801-52f6-a59a-e0398ce28620 with identifier: ZR26013
2026-03-30 05:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 25ffd493-8801-52f6-a59a-e0398ce28620 with identifier: ZR26013 to the API
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:43:53Z',
 'fuel_type': 'diesel',
 'id': '25ffd493-8801-52f6-a59a-e0398ce28620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR26013',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 229109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-20',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Saving data for ZR26013: {'auction_closing_time': 1774885433.0, 'created_time': 1773921684.938674, 'last_price_update_time': 1774846981.029974}
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR26013') HTTP/1.1" 204 0
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Scrape type for RM92541: 2
2026-03-30 05:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with identifier: RM92541
2026-03-30 05:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with scrape type 2
2026-03-30 05:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with scrape type 2
2026-03-30 05:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a, identifier: RM92541
2026-03-30 05:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with identifier: RM92541
2026-03-30 05:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with identifier: RM92541
2026-03-30 05:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with identifier: RM92541 to the API
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:47:30Z',
 'fuel_type': 'petrol',
 'id': '1d30c90e-fe5c-5f7c-969d-2e9401806f6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM92541',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 235083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-30',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TFSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2007}
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Saving data for RM92541: {'auction_closing_time': 1774885650.0, 'created_time': 1774638139.542216, 'last_price_update_time': 1774846981.432155}
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RM92541') HTTP/1.1" 204 0
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Scrape type for LS97590: 0
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-30 05:03:01 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Scrape type for XY26028: 2
2026-03-30 05:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d855dd6-7b15-5f52-a978-90a0880ffa41 with identifier: XY26028
2026-03-30 05:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d855dd6-7b15-5f52-a978-90a0880ffa41 with scrape type 2
2026-03-30 05:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d855dd6-7b15-5f52-a978-90a0880ffa41 with scrape type 2
2026-03-30 05:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5d855dd6-7b15-5f52-a978-90a0880ffa41, identifier: XY26028
2026-03-30 05:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5d855dd6-7b15-5f52-a978-90a0880ffa41 with identifier: XY26028
2026-03-30 05:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5d855dd6-7b15-5f52-a978-90a0880ffa41 with identifier: XY26028
2026-03-30 05:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5d855dd6-7b15-5f52-a978-90a0880ffa41 with identifier: XY26028 to the API
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:22Z',
 'fuel_type': 'petrol',
 'id': '5d855dd6-7b15-5f52-a978-90a0880ffa41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY26028',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 288528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-15',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-30 05:03:01 [auto1.nl] INFO: Saving data for XY26028: {'auction_closing_time': 1774884202.0, 'created_time': 1774638148.948817, 'last_price_update_time': 1774846981.886506}
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY26028') HTTP/1.1" 204 0
2026-03-30 05:03:02 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-30 05:03:02 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-30 05:03:02 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-30 05:03:02 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-30 05:03:02 [auto1.nl] INFO: Scrape type for VC22580: 2
2026-03-30 05:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed90480f-f56a-56e4-a6e6-283468156c1f with identifier: VC22580
2026-03-30 05:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed90480f-f56a-56e4-a6e6-283468156c1f with scrape type 2
2026-03-30 05:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed90480f-f56a-56e4-a6e6-283468156c1f with scrape type 2
2026-03-30 05:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ed90480f-f56a-56e4-a6e6-283468156c1f, identifier: VC22580
2026-03-30 05:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ed90480f-f56a-56e4-a6e6-283468156c1f with identifier: VC22580
2026-03-30 05:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ed90480f-f56a-56e4-a6e6-283468156c1f with identifier: VC22580
2026-03-30 05:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ed90480f-f56a-56e4-a6e6-283468156c1f with identifier: VC22580 to the API
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-30T15:05:56Z',
 'fuel_type': 'petrol',
 'id': 'ed90480f-f56a-56e4-a6e6-283468156c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC22580',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 190318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2020}
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-30 05:03:02 [auto1.nl] INFO: Saving data for VC22580: {'auction_closing_time': 1774883156.0, 'created_time': 1774638170.626725, 'last_price_update_time': 1774846982.408258}
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VC22580') HTTP/1.1" 204 0
2026-03-30 05:03:02 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-30 05:03:02 [auto1.nl] INFO: Scrape type for HR88481: 2
2026-03-30 05:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e81360d-d5fc-56b3-826b-ddc4e5870425 with identifier: HR88481
2026-03-30 05:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e81360d-d5fc-56b3-826b-ddc4e5870425 with scrape type 2
2026-03-30 05:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e81360d-d5fc-56b3-826b-ddc4e5870425 with scrape type 2
2026-03-30 05:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e81360d-d5fc-56b3-826b-ddc4e5870425, identifier: HR88481
2026-03-30 05:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e81360d-d5fc-56b3-826b-ddc4e5870425 with identifier: HR88481
2026-03-30 05:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e81360d-d5fc-56b3-826b-ddc4e5870425 with identifier: HR88481
2026-03-30 05:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e81360d-d5fc-56b3-826b-ddc4e5870425 with identifier: HR88481 to the API
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:23:40Z',
 'fuel_type': 'petrol',
 'id': '8e81360d-d5fc-56b3-826b-ddc4e5870425',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR88481',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 178866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-31',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2009}
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-30 05:03:02 [auto1.nl] INFO: Saving data for HR88481: {'auction_closing_time': 1774884220.0, 'created_time': 1774638172.479381, 'last_price_update_time': 1774846982.841801}
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HR88481') HTTP/1.1" 204 0
2026-03-30 05:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:03:07 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 758 | hits on page: 40
2026-03-30 05:03:07 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-30 05:03:07 [auto1.nl] INFO: Scrape type for SD85786: 2
2026-03-30 05:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b15ab99d-b245-5ac3-8467-1ba7d57fe263 with identifier: SD85786
2026-03-30 05:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b15ab99d-b245-5ac3-8467-1ba7d57fe263 with scrape type 2
2026-03-30 05:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b15ab99d-b245-5ac3-8467-1ba7d57fe263 with scrape type 2
2026-03-30 05:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b15ab99d-b245-5ac3-8467-1ba7d57fe263, identifier: SD85786
2026-03-30 05:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b15ab99d-b245-5ac3-8467-1ba7d57fe263 with identifier: SD85786
2026-03-30 05:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b15ab99d-b245-5ac3-8467-1ba7d57fe263 with identifier: SD85786
2026-03-30 05:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b15ab99d-b245-5ac3-8467-1ba7d57fe263 with identifier: SD85786 to the API
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:16Z',
 'fuel_type': 'diesel',
 'id': 'b15ab99d-b245-5ac3-8467-1ba7d57fe263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD85786',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 373169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-13',
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 D-4D VX',
 'transmission': 'manual',
 'trim': 'VX',
 'year': 2004}
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-30 05:03:07 [auto1.nl] INFO: Saving data for SD85786: {'auction_closing_time': 1774885816.0, 'created_time': 1774638177.146668, 'last_price_update_time': 1774846987.870044}
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD85786') HTTP/1.1" 204 0
2026-03-30 05:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:03:07 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-30 05:03:07 [auto1.nl] INFO: Scrape type for KP34214: 0
2026-03-30 05:03:07 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-30 05:03:07 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-30 05:03:07 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-30 05:03:07 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-30 05:03:07 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-30 05:03:07 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-30 05:03:08 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-30 05:03:08 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-30 05:03:08 [auto1.nl] INFO: Scrape type for XV86348: 2
2026-03-30 05:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with identifier: XV86348
2026-03-30 05:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with scrape type 2
2026-03-30 05:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with scrape type 2
2026-03-30 05:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a, identifier: XV86348
2026-03-30 05:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with identifier: XV86348
2026-03-30 05:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with identifier: XV86348
2026-03-30 05:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with identifier: XV86348 to the API
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:37:57Z',
 'fuel_type': 'petrol',
 'id': 'ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV86348',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 199609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-13',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-30 05:03:08 [auto1.nl] INFO: Saving data for XV86348: {'auction_closing_time': 1774885077.0, 'created_time': 1774638158.381218, 'last_price_update_time': 1774846988.422368}
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV86348') HTTP/1.1" 204 0
2026-03-30 05:03:08 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-30 05:03:08 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-30 05:03:08 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-30 05:03:08 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-30 05:03:08 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-30 05:03:08 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-30 05:03:08 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-30 05:03:08 [auto1.nl] INFO: Scrape type for BN97277: 2
2026-03-30 05:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b49c810-01bc-5d31-be02-25a52723b432 with identifier: BN97277
2026-03-30 05:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b49c810-01bc-5d31-be02-25a52723b432 with scrape type 2
2026-03-30 05:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b49c810-01bc-5d31-be02-25a52723b432 with scrape type 2
2026-03-30 05:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b49c810-01bc-5d31-be02-25a52723b432, identifier: BN97277
2026-03-30 05:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b49c810-01bc-5d31-be02-25a52723b432 with identifier: BN97277
2026-03-30 05:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b49c810-01bc-5d31-be02-25a52723b432 with identifier: BN97277
2026-03-30 05:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b49c810-01bc-5d31-be02-25a52723b432 with identifier: BN97277 to the API
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:36:30Z',
 'fuel_type': 'petrol',
 'id': '2b49c810-01bc-5d31-be02-25a52723b432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN97277',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 170060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Peugeot 308 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-30 05:03:08 [auto1.nl] INFO: Saving data for BN97277: {'auction_closing_time': 1774884990.0, 'created_time': 1773489664.448831, 'last_price_update_time': 1774846988.966084}
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN97277') HTTP/1.1" 204 0
2026-03-30 05:03:08 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-30 05:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-30 05:03:09 [auto1.nl] INFO: Scrape type for FD20387: 2
2026-03-30 05:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78d2d19f-a50a-5311-89f9-369e8bb29971 with identifier: FD20387
2026-03-30 05:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d2d19f-a50a-5311-89f9-369e8bb29971 with scrape type 2
2026-03-30 05:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78d2d19f-a50a-5311-89f9-369e8bb29971 with scrape type 2
2026-03-30 05:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78d2d19f-a50a-5311-89f9-369e8bb29971, identifier: FD20387
2026-03-30 05:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78d2d19f-a50a-5311-89f9-369e8bb29971 with identifier: FD20387
2026-03-30 05:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78d2d19f-a50a-5311-89f9-369e8bb29971 with identifier: FD20387
2026-03-30 05:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78d2d19f-a50a-5311-89f9-369e8bb29971 with identifier: FD20387 to the API
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:20:47Z',
 'fuel_type': 'petrol',
 'id': '78d2d19f-a50a-5311-89f9-369e8bb29971',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD20387',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 197943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-30 05:03:09 [auto1.nl] INFO: Saving data for FD20387: {'auction_closing_time': 1774884047.0, 'created_time': 1773923580.869206, 'last_price_update_time': 1774846989.400162}
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD20387') HTTP/1.1" 204 0
2026-03-30 05:03:09 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-30 05:03:09 [auto1.nl] INFO: Scrape type for NF42307: 2
2026-03-30 05:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07ed3611-9a15-5ad8-a3f5-64882f276078 with identifier: NF42307
2026-03-30 05:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07ed3611-9a15-5ad8-a3f5-64882f276078 with scrape type 2
2026-03-30 05:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07ed3611-9a15-5ad8-a3f5-64882f276078 with scrape type 2
2026-03-30 05:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 07ed3611-9a15-5ad8-a3f5-64882f276078, identifier: NF42307
2026-03-30 05:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 07ed3611-9a15-5ad8-a3f5-64882f276078 with identifier: NF42307
2026-03-30 05:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 07ed3611-9a15-5ad8-a3f5-64882f276078 with identifier: NF42307
2026-03-30 05:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 07ed3611-9a15-5ad8-a3f5-64882f276078 with identifier: NF42307 to the API
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:55:25Z',
 'fuel_type': 'petrol',
 'id': '07ed3611-9a15-5ad8-a3f5-64882f276078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF42307',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pixo',
 'odometer': 104886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-23',
 'seller_name': None,
 'title': 'Nissan Pixo 1.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-30 05:03:09 [auto1.nl] INFO: Saving data for NF42307: {'auction_closing_time': 1774886125.0, 'created_time': 1774638137.199035, 'last_price_update_time': 1774846989.828541}
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NF42307') HTTP/1.1" 204 0
2026-03-30 05:03:09 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-30 05:03:09 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-30 05:03:09 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-30 05:03:09 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-30 05:03:09 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-30 05:03:09 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-30 05:03:09 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-30 05:03:09 [auto1.nl] INFO: Scrape type for EG87315: 2
2026-03-30 05:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ece01be2-e1ea-577d-bce5-1ab157c812d5 with identifier: EG87315
2026-03-30 05:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ece01be2-e1ea-577d-bce5-1ab157c812d5 with scrape type 2
2026-03-30 05:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ece01be2-e1ea-577d-bce5-1ab157c812d5 with scrape type 2
2026-03-30 05:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ece01be2-e1ea-577d-bce5-1ab157c812d5, identifier: EG87315
2026-03-30 05:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ece01be2-e1ea-577d-bce5-1ab157c812d5 with identifier: EG87315
2026-03-30 05:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ece01be2-e1ea-577d-bce5-1ab157c812d5 with identifier: EG87315
2026-03-30 05:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ece01be2-e1ea-577d-bce5-1ab157c812d5 with identifier: EG87315 to the API
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:42:29Z',
 'fuel_type': 'petrol',
 'id': 'ece01be2-e1ea-577d-bce5-1ab157c812d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG87315',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 205989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-06',
 'seller_name': None,
 'title': 'Renault Espace 1.6 TCe Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2015}
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-30 05:03:10 [auto1.nl] INFO: Saving data for EG87315: {'auction_closing_time': 1774885349.0, 'created_time': 1773924766.464107, 'last_price_update_time': 1774846990.279169}
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG87315') HTTP/1.1" 204 0
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-30 05:03:10 [auto1.nl] INFO: Scrape type for KV59291: 0
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-30 05:03:10 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-30 05:03:10 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-30 05:03:10 [auto1.nl] INFO: Scrape type for GD14705: 2
2026-03-30 05:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 108c6f11-35df-560a-8a66-ea74a782e3a5 with identifier: GD14705
2026-03-30 05:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 108c6f11-35df-560a-8a66-ea74a782e3a5 with scrape type 2
2026-03-30 05:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 108c6f11-35df-560a-8a66-ea74a782e3a5 with scrape type 2
2026-03-30 05:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 108c6f11-35df-560a-8a66-ea74a782e3a5, identifier: GD14705
2026-03-30 05:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 108c6f11-35df-560a-8a66-ea74a782e3a5 with identifier: GD14705
2026-03-30 05:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 108c6f11-35df-560a-8a66-ea74a782e3a5 with identifier: GD14705
2026-03-30 05:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 108c6f11-35df-560a-8a66-ea74a782e3a5 with identifier: GD14705 to the API
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:41:34Z',
 'fuel_type': 'petrol',
 'id': '108c6f11-35df-560a-8a66-ea74a782e3a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD14705',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 91407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-30 05:03:10 [auto1.nl] INFO: Saving data for GD14705: {'auction_closing_time': 1774885294.0, 'created_time': 1774551643.226041, 'last_price_update_time': 1774846990.853821}
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD14705') HTTP/1.1" 204 0
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-30 05:03:10 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-30 05:03:10 [auto1.nl] INFO: Scrape type for LW98869: 2
2026-03-30 05:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e86e2b86-e406-5613-86d3-35a1265a36f2 with identifier: LW98869
2026-03-30 05:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e86e2b86-e406-5613-86d3-35a1265a36f2 with scrape type 2
2026-03-30 05:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e86e2b86-e406-5613-86d3-35a1265a36f2 with scrape type 2
2026-03-30 05:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e86e2b86-e406-5613-86d3-35a1265a36f2, identifier: LW98869
2026-03-30 05:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e86e2b86-e406-5613-86d3-35a1265a36f2 with identifier: LW98869
2026-03-30 05:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e86e2b86-e406-5613-86d3-35a1265a36f2 with identifier: LW98869
2026-03-30 05:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e86e2b86-e406-5613-86d3-35a1265a36f2 with identifier: LW98869 to the API
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-30T15:42:52Z',
 'fuel_type': 'petrol',
 'id': 'e86e2b86-e406-5613-86d3-35a1265a36f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW98869',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 124381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-10',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-30 05:03:11 [auto1.nl] INFO: Saving data for LW98869: {'auction_closing_time': 1774885372.0, 'created_time': 1773921666.53404, 'last_price_update_time': 1774846991.356409}
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW98869') HTTP/1.1" 204 0
2026-03-30 05:03:11 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-30 05:03:11 [auto1.nl] INFO: Scrape type for TA38332: 2
2026-03-30 05:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb01572-a79d-5bf5-b117-31cec6c1a85a with identifier: TA38332
2026-03-30 05:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb01572-a79d-5bf5-b117-31cec6c1a85a with scrape type 2
2026-03-30 05:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccb01572-a79d-5bf5-b117-31cec6c1a85a with scrape type 2
2026-03-30 05:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ccb01572-a79d-5bf5-b117-31cec6c1a85a, identifier: TA38332
2026-03-30 05:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ccb01572-a79d-5bf5-b117-31cec6c1a85a with identifier: TA38332
2026-03-30 05:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ccb01572-a79d-5bf5-b117-31cec6c1a85a with identifier: TA38332
2026-03-30 05:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ccb01572-a79d-5bf5-b117-31cec6c1a85a with identifier: TA38332 to the API
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:17Z',
 'fuel_type': 'petrol',
 'id': 'ccb01572-a79d-5bf5-b117-31cec6c1a85a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA38332',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 255998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-05',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T3 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2011}
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-30 05:03:11 [auto1.nl] INFO: Saving data for TA38332: {'auction_closing_time': 1774884617.0, 'created_time': 1773133312.387999, 'last_price_update_time': 1774846991.769431}
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA38332') HTTP/1.1" 204 0
2026-03-30 05:03:11 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-30 05:03:11 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-30 05:03:11 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-30 05:03:11 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-30 05:03:11 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-30 05:03:11 [auto1.nl] INFO: Scrape type for JP82620: 2
2026-03-30 05:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cbce85e-97df-5832-9937-7d228282e156 with identifier: JP82620
2026-03-30 05:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cbce85e-97df-5832-9937-7d228282e156 with scrape type 2
2026-03-30 05:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cbce85e-97df-5832-9937-7d228282e156 with scrape type 2
2026-03-30 05:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8cbce85e-97df-5832-9937-7d228282e156, identifier: JP82620
2026-03-30 05:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8cbce85e-97df-5832-9937-7d228282e156 with identifier: JP82620
2026-03-30 05:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8cbce85e-97df-5832-9937-7d228282e156 with identifier: JP82620
2026-03-30 05:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8cbce85e-97df-5832-9937-7d228282e156 with identifier: JP82620 to the API
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:47:29Z',
 'fuel_type': 'petrol',
 'id': '8cbce85e-97df-5832-9937-7d228282e156',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP82620',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 204901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-20',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2009}
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-30 05:03:12 [auto1.nl] INFO: Saving data for JP82620: {'auction_closing_time': 1774885649.0, 'created_time': 1774638140.699923, 'last_price_update_time': 1774846992.19106}
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JP82620') HTTP/1.1" 204 0
2026-03-30 05:03:12 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-30 05:03:12 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-30 05:03:12 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-30 05:03:12 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-30 05:03:12 [auto1.nl] INFO: Scrape type for ZA96365: 2
2026-03-30 05:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16e17aac-f34e-5577-800b-58cdb3a259fe with identifier: ZA96365
2026-03-30 05:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16e17aac-f34e-5577-800b-58cdb3a259fe with scrape type 2
2026-03-30 05:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16e17aac-f34e-5577-800b-58cdb3a259fe with scrape type 2
2026-03-30 05:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 16e17aac-f34e-5577-800b-58cdb3a259fe, identifier: ZA96365
2026-03-30 05:03:12 [scrapy.extensions.logstats] INFO: Crawled 17 pages (at 7 pages/min), scraped 79 items (at 60 items/min)
2026-03-30 05:03:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-30 05:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 16e17aac-f34e-5577-800b-58cdb3a259fe with identifier: ZA96365
2026-03-30 05:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 16e17aac-f34e-5577-800b-58cdb3a259fe with identifier: ZA96365
2026-03-30 05:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 16e17aac-f34e-5577-800b-58cdb3a259fe with identifier: ZA96365 to the API
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:50:45Z',
 'fuel_type': 'petrol',
 'id': '16e17aac-f34e-5577-800b-58cdb3a259fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA96365',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 347947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-08',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-30 05:03:12 [auto1.nl] INFO: Saving data for ZA96365: {'auction_closing_time': 1774885845.0, 'created_time': 1773922784.681273, 'last_price_update_time': 1774846992.609491}
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZA96365') HTTP/1.1" 204 0
2026-03-30 05:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:03:13 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 758 | hits on page: 40
2026-03-30 05:03:13 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-30 05:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-30 05:03:13 [auto1.nl] INFO: Scrape type for BH50437: 2
2026-03-30 05:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc500800-7a85-5295-864a-159c54db01cd with identifier: BH50437
2026-03-30 05:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc500800-7a85-5295-864a-159c54db01cd with scrape type 2
2026-03-30 05:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc500800-7a85-5295-864a-159c54db01cd with scrape type 2
2026-03-30 05:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc500800-7a85-5295-864a-159c54db01cd, identifier: BH50437
2026-03-30 05:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc500800-7a85-5295-864a-159c54db01cd with identifier: BH50437
2026-03-30 05:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc500800-7a85-5295-864a-159c54db01cd with identifier: BH50437
2026-03-30 05:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc500800-7a85-5295-864a-159c54db01cd with identifier: BH50437 to the API
2026-03-30 05:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:15:29Z',
 'fuel_type': 'diesel',
 'id': 'fc500800-7a85-5295-864a-159c54db01cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH50437',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 308741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-25',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2010}
2026-03-30 05:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-30 05:03:13 [auto1.nl] INFO: Saving data for BH50437: {'auction_closing_time': 1774883729.0, 'created_time': 1774551631.673284, 'last_price_update_time': 1774846993.888529}
2026-03-30 05:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BH50437') HTTP/1.1" 204 0
2026-03-30 05:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:03:13 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-30 05:03:13 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-30 05:03:14 [auto1.nl] INFO: Scrape type for WP75740: 2
2026-03-30 05:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1993dc-4522-5244-a2f5-7a4314a9b62b with identifier: WP75740
2026-03-30 05:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1993dc-4522-5244-a2f5-7a4314a9b62b with scrape type 2
2026-03-30 05:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b1993dc-4522-5244-a2f5-7a4314a9b62b with scrape type 2
2026-03-30 05:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1b1993dc-4522-5244-a2f5-7a4314a9b62b, identifier: WP75740
2026-03-30 05:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1b1993dc-4522-5244-a2f5-7a4314a9b62b with identifier: WP75740
2026-03-30 05:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1b1993dc-4522-5244-a2f5-7a4314a9b62b with identifier: WP75740
2026-03-30 05:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1b1993dc-4522-5244-a2f5-7a4314a9b62b with identifier: WP75740 to the API
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:41:50Z',
 'fuel_type': 'petrol',
 'id': '1b1993dc-4522-5244-a2f5-7a4314a9b62b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP75740',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 227439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-02',
 'seller_name': None,
 'title': 'Peugeot 407 3.0 V6 Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2005}
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-30 05:03:14 [auto1.nl] INFO: Saving data for WP75740: {'auction_closing_time': 1774885310.0, 'created_time': 1774551671.066531, 'last_price_update_time': 1774846994.380801}
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WP75740') HTTP/1.1" 204 0
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-30 05:03:14 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-30 05:03:14 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-30 05:03:14 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-30 05:03:14 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-30 05:03:14 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-30 05:03:14 [auto1.nl] INFO: Scrape type for JJ92825: 2
2026-03-30 05:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ff71f83-0f7c-5b37-9a34-13257e58632b with identifier: JJ92825
2026-03-30 05:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ff71f83-0f7c-5b37-9a34-13257e58632b with scrape type 2
2026-03-30 05:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ff71f83-0f7c-5b37-9a34-13257e58632b with scrape type 2
2026-03-30 05:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ff71f83-0f7c-5b37-9a34-13257e58632b, identifier: JJ92825
2026-03-30 05:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ff71f83-0f7c-5b37-9a34-13257e58632b with identifier: JJ92825
2026-03-30 05:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ff71f83-0f7c-5b37-9a34-13257e58632b with identifier: JJ92825
2026-03-30 05:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ff71f83-0f7c-5b37-9a34-13257e58632b with identifier: JJ92825 to the API
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:43:08Z',
 'fuel_type': 'petrol',
 'id': '8ff71f83-0f7c-5b37-9a34-13257e58632b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ92825',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 91220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0-VVT-i X- Style',
 'transmission': 'manual',
 'trim': 'X- Style',
 'year': 2017}
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-30 05:03:14 [auto1.nl] INFO: Saving data for JJ92825: {'auction_closing_time': 1774885388.0, 'created_time': 1773921684.245869, 'last_price_update_time': 1774846994.900916}
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JJ92825') HTTP/1.1" 204 0
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-30 05:03:15 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-30 05:03:15 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-30 05:03:15 [auto1.nl] INFO: Scrape type for BB94394: 2
2026-03-30 05:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93934ec-3fba-5968-8c52-ae1ceb8e0535 with identifier: BB94394
2026-03-30 05:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93934ec-3fba-5968-8c52-ae1ceb8e0535 with scrape type 2
2026-03-30 05:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d93934ec-3fba-5968-8c52-ae1ceb8e0535 with scrape type 2
2026-03-30 05:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d93934ec-3fba-5968-8c52-ae1ceb8e0535, identifier: BB94394
2026-03-30 05:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d93934ec-3fba-5968-8c52-ae1ceb8e0535 with identifier: BB94394
2026-03-30 05:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d93934ec-3fba-5968-8c52-ae1ceb8e0535 with identifier: BB94394
2026-03-30 05:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d93934ec-3fba-5968-8c52-ae1ceb8e0535 with identifier: BB94394 to the API
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:49:27Z',
 'fuel_type': 'petrol',
 'id': 'd93934ec-3fba-5968-8c52-ae1ceb8e0535',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB94394',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 59468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-04',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'automatic',
 'trim': 'Filou',
 'year': 2010}
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-30 05:03:15 [auto1.nl] INFO: Saving data for BB94394: {'auction_closing_time': 1774885767.0, 'created_time': 1774551635.242074, 'last_price_update_time': 1774846995.509134}
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BB94394') HTTP/1.1" 204 0
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-30 05:03:15 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-30 05:03:15 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-30 05:03:15 [auto1.nl] INFO: Scrape type for UT96124: 2
2026-03-30 05:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28511c30-641a-5e1a-a24e-6bf435694c18 with identifier: UT96124
2026-03-30 05:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28511c30-641a-5e1a-a24e-6bf435694c18 with scrape type 2
2026-03-30 05:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28511c30-641a-5e1a-a24e-6bf435694c18 with scrape type 2
2026-03-30 05:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28511c30-641a-5e1a-a24e-6bf435694c18, identifier: UT96124
2026-03-30 05:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28511c30-641a-5e1a-a24e-6bf435694c18 with identifier: UT96124
2026-03-30 05:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28511c30-641a-5e1a-a24e-6bf435694c18 with identifier: UT96124
2026-03-30 05:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28511c30-641a-5e1a-a24e-6bf435694c18 with identifier: UT96124 to the API
2026-03-30 05:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:13:40Z',
 'fuel_type': 'petrol',
 'id': '28511c30-641a-5e1a-a24e-6bf435694c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT96124',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 202533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-09',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 V8 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2013}
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-30 05:03:16 [auto1.nl] INFO: Saving data for UT96124: {'auction_closing_time': 1774883620.0, 'created_time': 1773924922.1521, 'last_price_update_time': 1774846996.421973}
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UT96124') HTTP/1.1" 204 0
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-30 05:03:16 [auto1.nl] INFO: Scrape type for MX73700: 0
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-30 05:03:16 [auto1.nl] INFO: Scrape type for KW64079: 0
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-30 05:03:16 [auto1.nl] INFO: Scrape type for GV91252: 0
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-30 05:03:16 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-30 05:03:16 [auto1.nl] INFO: Scrape type for VE70887: 2
2026-03-30 05:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc7060c-073b-58de-beef-c8508d6409d4 with identifier: VE70887
2026-03-30 05:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc7060c-073b-58de-beef-c8508d6409d4 with scrape type 2
2026-03-30 05:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bc7060c-073b-58de-beef-c8508d6409d4 with scrape type 2
2026-03-30 05:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6bc7060c-073b-58de-beef-c8508d6409d4, identifier: VE70887
2026-03-30 05:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6bc7060c-073b-58de-beef-c8508d6409d4 with identifier: VE70887
2026-03-30 05:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6bc7060c-073b-58de-beef-c8508d6409d4 with identifier: VE70887
2026-03-30 05:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6bc7060c-073b-58de-beef-c8508d6409d4 with identifier: VE70887 to the API
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:58Z',
 'fuel_type': 'diesel',
 'id': '6bc7060c-073b-58de-beef-c8508d6409d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE70887',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 385226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-30 05:03:16 [auto1.nl] INFO: Saving data for VE70887: {'auction_closing_time': 1774886398.0, 'created_time': 1774724504.456962, 'last_price_update_time': 1774846996.95044}
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VE70887') HTTP/1.1" 204 0
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-30 05:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:03:17 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 758 | hits on page: 40
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-30 05:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-30 05:03:17 [auto1.nl] INFO: Scrape type for TY41517: 0
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-30 05:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-30 05:03:17 [auto1.nl] INFO: Scrape type for WP58537: 0
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-30 05:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-30 05:03:17 [auto1.nl] INFO: Scrape type for LE21715: 0
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-30 05:03:17 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-30 05:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-30 05:03:17 [auto1.nl] INFO: Scrape type for JH71745: 2
2026-03-30 05:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e3d968-bcbc-5d27-9e67-ea84945e2713 with identifier: JH71745
2026-03-30 05:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e3d968-bcbc-5d27-9e67-ea84945e2713 with scrape type 2
2026-03-30 05:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44e3d968-bcbc-5d27-9e67-ea84945e2713 with scrape type 2
2026-03-30 05:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 44e3d968-bcbc-5d27-9e67-ea84945e2713, identifier: JH71745
2026-03-30 05:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 44e3d968-bcbc-5d27-9e67-ea84945e2713 with identifier: JH71745
2026-03-30 05:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 44e3d968-bcbc-5d27-9e67-ea84945e2713 with identifier: JH71745
2026-03-30 05:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 44e3d968-bcbc-5d27-9e67-ea84945e2713 with identifier: JH71745 to the API
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:42:15Z',
 'fuel_type': 'petrol',
 'id': '44e3d968-bcbc-5d27-9e67-ea84945e2713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH71745',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 113278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-14',
 'seller_name': None,
 'title': 'Ford S-Max 1.5 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-30 05:03:18 [auto1.nl] INFO: Saving data for JH71745: {'auction_closing_time': 1774885335.0, 'created_time': 1774724504.893789, 'last_price_update_time': 1774846998.297291}
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH71745') HTTP/1.1" 204 0
2026-03-30 05:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:03:18 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-30 05:03:18 [auto1.nl] INFO: Scrape type for BL89669: 0
2026-03-30 05:03:18 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-30 05:03:18 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-30 05:03:18 [auto1.nl] INFO: Scrape type for HN54837: 2
2026-03-30 05:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ecbafa2-810c-556f-93a0-421d7c30c287 with identifier: HN54837
2026-03-30 05:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ecbafa2-810c-556f-93a0-421d7c30c287 with scrape type 2
2026-03-30 05:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ecbafa2-810c-556f-93a0-421d7c30c287 with scrape type 2
2026-03-30 05:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ecbafa2-810c-556f-93a0-421d7c30c287, identifier: HN54837
2026-03-30 05:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ecbafa2-810c-556f-93a0-421d7c30c287 with identifier: HN54837
2026-03-30 05:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ecbafa2-810c-556f-93a0-421d7c30c287 with identifier: HN54837
2026-03-30 05:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ecbafa2-810c-556f-93a0-421d7c30c287 with identifier: HN54837 to the API
2026-03-30 05:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:03:36Z',
 'fuel_type': 'petrol',
 'id': '4ecbafa2-810c-556f-93a0-421d7c30c287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN54837',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 33977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-30 05:03:19 [auto1.nl] INFO: Saving data for HN54837: {'auction_closing_time': 1774883016.0, 'created_time': 1774724497.237239, 'last_price_update_time': 1774846999.390718}
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HN54837') HTTP/1.1" 204 0
2026-03-30 05:03:19 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-30 05:03:19 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-30 05:03:19 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-30 05:03:19 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-30 05:03:19 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-30 05:03:19 [auto1.nl] INFO: Scrape type for XK63885: 2
2026-03-30 05:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa4fe243-a109-598c-934e-d9090d7d464c with identifier: XK63885
2026-03-30 05:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4fe243-a109-598c-934e-d9090d7d464c with scrape type 2
2026-03-30 05:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa4fe243-a109-598c-934e-d9090d7d464c with scrape type 2
2026-03-30 05:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa4fe243-a109-598c-934e-d9090d7d464c, identifier: XK63885
2026-03-30 05:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa4fe243-a109-598c-934e-d9090d7d464c with identifier: XK63885
2026-03-30 05:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa4fe243-a109-598c-934e-d9090d7d464c with identifier: XK63885
2026-03-30 05:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa4fe243-a109-598c-934e-d9090d7d464c with identifier: XK63885 to the API
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:52:39Z',
 'fuel_type': 'petrol',
 'id': 'fa4fe243-a109-598c-934e-d9090d7d464c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK63885',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 43045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-30 05:03:19 [auto1.nl] INFO: Saving data for XK63885: {'auction_closing_time': 1774885959.0, 'created_time': 1774724498.241946, 'last_price_update_time': 1774846999.896082}
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XK63885') HTTP/1.1" 204 0
2026-03-30 05:03:19 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-30 05:03:19 [auto1.nl] INFO: Scrape type for BJ61509: 0
2026-03-30 05:03:19 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-30 05:03:19 [auto1.nl] INFO: Scrape type for RH72913: 0
2026-03-30 05:03:19 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-30 05:03:19 [auto1.nl] INFO: Scrape type for SR45817: 2
2026-03-30 05:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 457c3195-896b-557f-a471-daa91da61c90 with identifier: SR45817
2026-03-30 05:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 457c3195-896b-557f-a471-daa91da61c90 with scrape type 2
2026-03-30 05:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 457c3195-896b-557f-a471-daa91da61c90 with scrape type 2
2026-03-30 05:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 457c3195-896b-557f-a471-daa91da61c90, identifier: SR45817
2026-03-30 05:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 457c3195-896b-557f-a471-daa91da61c90 with identifier: SR45817
2026-03-30 05:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 457c3195-896b-557f-a471-daa91da61c90 with identifier: SR45817
2026-03-30 05:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 457c3195-896b-557f-a471-daa91da61c90 with identifier: SR45817 to the API
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:01:16Z',
 'fuel_type': 'petrol',
 'id': '457c3195-896b-557f-a471-daa91da61c90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR45817',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 139864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-12',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-30 05:03:20 [auto1.nl] INFO: Saving data for SR45817: {'auction_closing_time': 1774882876.0, 'created_time': 1774724492.87095, 'last_price_update_time': 1774847000.304186}
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SR45817') HTTP/1.1" 204 0
2026-03-30 05:03:20 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-30 05:03:20 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-30 05:03:20 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-30 05:03:20 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-30 05:03:20 [auto1.nl] INFO: Scrape type for EC40520: 2
2026-03-30 05:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afffbfb-f694-58b9-8f01-92e4581e3ccd with identifier: EC40520
2026-03-30 05:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd with scrape type 2
2026-03-30 05:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2afffbfb-f694-58b9-8f01-92e4581e3ccd with scrape type 2
2026-03-30 05:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2afffbfb-f694-58b9-8f01-92e4581e3ccd, identifier: EC40520
2026-03-30 05:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2afffbfb-f694-58b9-8f01-92e4581e3ccd with identifier: EC40520
2026-03-30 05:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2afffbfb-f694-58b9-8f01-92e4581e3ccd with identifier: EC40520
2026-03-30 05:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2afffbfb-f694-58b9-8f01-92e4581e3ccd with identifier: EC40520 to the API
2026-03-30 05:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:56:04Z',
 'fuel_type': 'petrol',
 'id': '2afffbfb-f694-58b9-8f01-92e4581e3ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC40520',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 165707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-25',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2007}
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-30 05:03:21 [auto1.nl] INFO: Saving data for EC40520: {'auction_closing_time': 1774886164.0, 'created_time': 1774724494.446989, 'last_price_update_time': 1774847001.377219}
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EC40520') HTTP/1.1" 204 0
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-30 05:03:21 [auto1.nl] INFO: Scrape type for LL30088: 0
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-30 05:03:21 [auto1.nl] INFO: Scrape type for SN61945: 0
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-30 05:03:21 [auto1.nl] INFO: Scrape type for ZK31432: 0
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-30 05:03:21 [auto1.nl] INFO: Scrape type for GN14496: 2
2026-03-30 05:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with identifier: GN14496
2026-03-30 05:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with scrape type 2
2026-03-30 05:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with scrape type 2
2026-03-30 05:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0896c112-e4d6-50a4-993f-d65dbf1f4d35, identifier: GN14496
2026-03-30 05:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with identifier: GN14496
2026-03-30 05:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with identifier: GN14496
2026-03-30 05:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0896c112-e4d6-50a4-993f-d65dbf1f4d35 with identifier: GN14496 to the API
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:25:23Z',
 'fuel_type': 'petrol',
 'id': '0896c112-e4d6-50a4-993f-d65dbf1f4d35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN14496',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 158610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-25',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-30 05:03:21 [auto1.nl] INFO: Saving data for GN14496: {'auction_closing_time': 1774884323.0, 'created_time': 1774724496.437203, 'last_price_update_time': 1774847001.941898}
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN14496') HTTP/1.1" 204 0
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-30 05:03:21 [auto1.nl] INFO: Scrape type for WH58354: 0
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-30 05:03:21 [auto1.nl] INFO: Scrape type for VZ88435: 0
2026-03-30 05:03:21 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK58084%27 HTTP/1.1" 200 None
2026-03-30 05:03:22 [auto1.nl] INFO: Scrape type for ZK58084: 2
2026-03-30 05:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b05dd1f-a98a-5382-830e-f4e6f403a4f3 with identifier: ZK58084
2026-03-30 05:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b05dd1f-a98a-5382-830e-f4e6f403a4f3 with scrape type 2
2026-03-30 05:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b05dd1f-a98a-5382-830e-f4e6f403a4f3 with scrape type 2
2026-03-30 05:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b05dd1f-a98a-5382-830e-f4e6f403a4f3, identifier: ZK58084
2026-03-30 05:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b05dd1f-a98a-5382-830e-f4e6f403a4f3 with identifier: ZK58084
2026-03-30 05:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b05dd1f-a98a-5382-830e-f4e6f403a4f3 with identifier: ZK58084
2026-03-30 05:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b05dd1f-a98a-5382-830e-f4e6f403a4f3 with identifier: ZK58084 to the API
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:28:24Z',
 'fuel_type': 'petrol',
 'id': '8b05dd1f-a98a-5382-830e-f4e6f403a4f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK58084',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 92125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-04',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Elegance Start/Stop',
 'transmission': 'manual',
 'trim': 'Elegance Start/Stop',
 'year': 2020}
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK58084%27 HTTP/1.1" 200 None
2026-03-30 05:03:22 [auto1.nl] INFO: Saving data for ZK58084: {'auction_closing_time': 1774884504.0, 'created_time': 1774353782.363192, 'last_price_update_time': 1774847002.369769}
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK58084') HTTP/1.1" 204 0
2026-03-30 05:03:22 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-30 05:03:22 [auto1.nl] INFO: Scrape type for ZN70459: 0
2026-03-30 05:03:22 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-30 05:03:22 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-30 05:03:22 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-30 05:03:22 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-30 05:03:22 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-30 05:03:22 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-30 05:03:22 [auto1.nl] INFO: Scrape type for FE67699: 0
2026-03-30 05:03:22 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-30 05:03:22 [auto1.nl] INFO: Scrape type for XU82529: 2
2026-03-30 05:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with identifier: XU82529
2026-03-30 05:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with scrape type 2
2026-03-30 05:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with scrape type 2
2026-03-30 05:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69, identifier: XU82529
2026-03-30 05:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with identifier: XU82529
2026-03-30 05:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with identifier: XU82529
2026-03-30 05:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ae0b164-4798-5bb4-9fab-9fc1b2249c69 with identifier: XU82529 to the API
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:40:19Z',
 'fuel_type': 'petrol',
 'id': '9ae0b164-4798-5bb4-9fab-9fc1b2249c69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU82529',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 85432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-07',
 'seller_name': None,
 'title': 'BMW 7er 750i L',
 'transmission': 'automatic',
 'trim': 'L',
 'year': 2009}
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-30 05:03:22 [auto1.nl] INFO: Saving data for XU82529: {'auction_closing_time': 1774885219.0, 'created_time': 1774724512.21818, 'last_price_update_time': 1774847002.80591}
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XU82529') HTTP/1.1" 204 0
2026-03-30 05:04:12 [scrapy.extensions.logstats] INFO: Crawled 19 pages (at 2 pages/min), scraped 94 items (at 15 items/min)
2026-03-30 05:04:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-30 05:05:12 [scrapy.extensions.logstats] INFO: Crawled 19 pages (at 0 pages/min), scraped 94 items (at 0 items/min)
2026-03-30 05:05:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-30 05:05:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.763(s), this was the 1st time calling it.
2026-03-30 05:05:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.692113662026227 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 05:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 05:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:05:36 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 758 | hits on page: 40
2026-03-30 05:05:36 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-30 05:05:36 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-30 05:05:36 [auto1.nl] INFO: Scrape type for VZ65695: 2
2026-03-30 05:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0b0f05-0f96-5994-be70-04a2adef2a1d with identifier: VZ65695
2026-03-30 05:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d with scrape type 2
2026-03-30 05:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0b0f05-0f96-5994-be70-04a2adef2a1d with scrape type 2
2026-03-30 05:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a0b0f05-0f96-5994-be70-04a2adef2a1d, identifier: VZ65695
2026-03-30 05:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a0b0f05-0f96-5994-be70-04a2adef2a1d with identifier: VZ65695
2026-03-30 05:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a0b0f05-0f96-5994-be70-04a2adef2a1d with identifier: VZ65695
2026-03-30 05:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a0b0f05-0f96-5994-be70-04a2adef2a1d with identifier: VZ65695 to the API
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:12:11Z',
 'fuel_type': 'petrol',
 'id': '8a0b0f05-0f96-5994-be70-04a2adef2a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ65695',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 180854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-03',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-30 05:05:36 [auto1.nl] INFO: Saving data for VZ65695: {'auction_closing_time': 1774883531.0, 'created_time': 1774724509.870854, 'last_price_update_time': 1774847136.956017}
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VZ65695') HTTP/1.1" 204 0
2026-03-30 05:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:05:36 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-30 05:05:36 [auto1.nl] INFO: Scrape type for GU70185: 2
2026-03-30 05:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f3daf4-1b50-5132-8844-a271f81c8908 with identifier: GU70185
2026-03-30 05:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f3daf4-1b50-5132-8844-a271f81c8908 with scrape type 2
2026-03-30 05:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0f3daf4-1b50-5132-8844-a271f81c8908 with scrape type 2
2026-03-30 05:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c0f3daf4-1b50-5132-8844-a271f81c8908, identifier: GU70185
2026-03-30 05:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c0f3daf4-1b50-5132-8844-a271f81c8908 with identifier: GU70185
2026-03-30 05:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c0f3daf4-1b50-5132-8844-a271f81c8908 with identifier: GU70185
2026-03-30 05:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c0f3daf4-1b50-5132-8844-a271f81c8908 with identifier: GU70185 to the API
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:40:27Z',
 'fuel_type': 'petrol',
 'id': 'c0f3daf4-1b50-5132-8844-a271f81c8908',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU70185',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 91209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-25',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-30 05:05:37 [auto1.nl] INFO: Saving data for GU70185: {'auction_closing_time': 1774885227.0, 'created_time': 1774724508.82616, 'last_price_update_time': 1774847137.338687}
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GU70185') HTTP/1.1" 204 0
2026-03-30 05:05:37 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-30 05:05:37 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-30 05:05:37 [auto1.nl] INFO: Scrape type for GD33520: 2
2026-03-30 05:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6898af0-474d-5809-b3f5-b9bfdc46a8dd with identifier: GD33520
2026-03-30 05:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd with scrape type 2
2026-03-30 05:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6898af0-474d-5809-b3f5-b9bfdc46a8dd with scrape type 2
2026-03-30 05:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6898af0-474d-5809-b3f5-b9bfdc46a8dd, identifier: GD33520
2026-03-30 05:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6898af0-474d-5809-b3f5-b9bfdc46a8dd with identifier: GD33520
2026-03-30 05:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6898af0-474d-5809-b3f5-b9bfdc46a8dd with identifier: GD33520
2026-03-30 05:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6898af0-474d-5809-b3f5-b9bfdc46a8dd with identifier: GD33520 to the API
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:13:00Z',
 'fuel_type': 'petrol',
 'id': 'd6898af0-474d-5809-b3f5-b9bfdc46a8dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD33520',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 230320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2014}
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-30 05:05:37 [auto1.nl] INFO: Saving data for GD33520: {'auction_closing_time': 1774883580.0, 'created_time': 1774724510.561971, 'last_price_update_time': 1774847137.734899}
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD33520') HTTP/1.1" 204 0
2026-03-30 05:05:37 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-30 05:05:37 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-30 05:05:37 [auto1.nl] INFO: Scrape type for PS01910: 2
2026-03-30 05:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124fbde1-ed8c-5bee-98c0-6a40c825edbc with identifier: PS01910
2026-03-30 05:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc with scrape type 2
2026-03-30 05:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124fbde1-ed8c-5bee-98c0-6a40c825edbc with scrape type 2
2026-03-30 05:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 124fbde1-ed8c-5bee-98c0-6a40c825edbc, identifier: PS01910
2026-03-30 05:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 124fbde1-ed8c-5bee-98c0-6a40c825edbc with identifier: PS01910
2026-03-30 05:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 124fbde1-ed8c-5bee-98c0-6a40c825edbc with identifier: PS01910
2026-03-30 05:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 124fbde1-ed8c-5bee-98c0-6a40c825edbc with identifier: PS01910 to the API
2026-03-30 05:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:07Z',
 'fuel_type': 'petrol',
 'id': '124fbde1-ed8c-5bee-98c0-6a40c825edbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS01910',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 234561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-12',
 'seller_name': None,
 'title': 'Opel Vectra 1.8 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2006}
2026-03-30 05:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-30 05:05:38 [auto1.nl] INFO: Saving data for PS01910: {'auction_closing_time': 1774884847.0, 'created_time': 1774724528.89852, 'last_price_update_time': 1774847138.714168}
2026-03-30 05:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS01910') HTTP/1.1" 204 0
2026-03-30 05:05:38 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-30 05:05:38 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-30 05:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-30 05:05:38 [auto1.nl] INFO: Scrape type for AB54003: 2
2026-03-30 05:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with identifier: AB54003
2026-03-30 05:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with scrape type 2
2026-03-30 05:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with scrape type 2
2026-03-30 05:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04, identifier: AB54003
2026-03-30 05:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with identifier: AB54003
2026-03-30 05:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with identifier: AB54003
2026-03-30 05:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e6087bb-7fb1-5752-9efd-86bcbca3bd04 with identifier: AB54003 to the API
2026-03-30 05:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:22:01Z',
 'fuel_type': 'hybrid',
 'id': '8e6087bb-7fb1-5752-9efd-86bcbca3bd04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB54003',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 88448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-30 05:05:39 [auto1.nl] INFO: Saving data for AB54003: {'auction_closing_time': 1774884121.0, 'created_time': 1774724512.597275, 'last_price_update_time': 1774847139.141442}
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB54003') HTTP/1.1" 204 0
2026-03-30 05:05:39 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-30 05:05:39 [auto1.nl] INFO: Scrape type for HD36341: 2
2026-03-30 05:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 418766cd-2652-531c-ae84-79122e35eebb with identifier: HD36341
2026-03-30 05:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 418766cd-2652-531c-ae84-79122e35eebb with scrape type 2
2026-03-30 05:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 418766cd-2652-531c-ae84-79122e35eebb with scrape type 2
2026-03-30 05:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 418766cd-2652-531c-ae84-79122e35eebb, identifier: HD36341
2026-03-30 05:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 418766cd-2652-531c-ae84-79122e35eebb with identifier: HD36341
2026-03-30 05:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 418766cd-2652-531c-ae84-79122e35eebb with identifier: HD36341
2026-03-30 05:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 418766cd-2652-531c-ae84-79122e35eebb with identifier: HD36341 to the API
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:41:44Z',
 'fuel_type': 'petrol',
 'id': '418766cd-2652-531c-ae84-79122e35eebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD36341',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 176730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-29',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-30 05:05:39 [auto1.nl] INFO: Saving data for HD36341: {'auction_closing_time': 1774885304.0, 'created_time': 1774724506.780562, 'last_price_update_time': 1774847139.609874}
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HD36341') HTTP/1.1" 204 0
2026-03-30 05:05:39 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-30 05:05:39 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-30 05:05:39 [auto1.nl] INFO: Scrape type for JA81822: 2
2026-03-30 05:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598b1327-4c58-5b56-962a-8a6cc715d2f9 with identifier: JA81822
2026-03-30 05:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598b1327-4c58-5b56-962a-8a6cc715d2f9 with scrape type 2
2026-03-30 05:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 598b1327-4c58-5b56-962a-8a6cc715d2f9 with scrape type 2
2026-03-30 05:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 598b1327-4c58-5b56-962a-8a6cc715d2f9, identifier: JA81822
2026-03-30 05:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 598b1327-4c58-5b56-962a-8a6cc715d2f9 with identifier: JA81822
2026-03-30 05:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 598b1327-4c58-5b56-962a-8a6cc715d2f9 with identifier: JA81822
2026-03-30 05:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 598b1327-4c58-5b56-962a-8a6cc715d2f9 with identifier: JA81822 to the API
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'petrol',
 'id': '598b1327-4c58-5b56-962a-8a6cc715d2f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA81822',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 204370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-08',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2012}
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Saving data for JA81822: {'auction_closing_time': 1774884566.0, 'created_time': 1774724506.233107, 'last_price_update_time': 1774847140.013023}
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JA81822') HTTP/1.1" 204 0
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Scrape type for JA39510: 2
2026-03-30 05:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with identifier: JA39510
2026-03-30 05:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with scrape type 2
2026-03-30 05:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with scrape type 2
2026-03-30 05:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ea6a973-540e-591c-a7e6-4b7cc45585c6, identifier: JA39510
2026-03-30 05:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with identifier: JA39510
2026-03-30 05:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with identifier: JA39510
2026-03-30 05:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ea6a973-540e-591c-a7e6-4b7cc45585c6 with identifier: JA39510 to the API
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:59:36Z',
 'fuel_type': 'petrol',
 'id': '8ea6a973-540e-591c-a7e6-4b7cc45585c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA39510',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 166884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Saving data for JA39510: {'auction_closing_time': 1774886376.0, 'created_time': 1774724509.500465, 'last_price_update_time': 1774847140.500947}
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JA39510') HTTP/1.1" 204 0
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Scrape type for AD33035: 0
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Scrape type for NJ31093: 2
2026-03-30 05:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dcd5990-dc58-5159-9e16-8167e7bda145 with identifier: NJ31093
2026-03-30 05:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dcd5990-dc58-5159-9e16-8167e7bda145 with scrape type 2
2026-03-30 05:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dcd5990-dc58-5159-9e16-8167e7bda145 with scrape type 2
2026-03-30 05:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9dcd5990-dc58-5159-9e16-8167e7bda145, identifier: NJ31093
2026-03-30 05:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9dcd5990-dc58-5159-9e16-8167e7bda145 with identifier: NJ31093
2026-03-30 05:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9dcd5990-dc58-5159-9e16-8167e7bda145 with identifier: NJ31093
2026-03-30 05:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9dcd5990-dc58-5159-9e16-8167e7bda145 with identifier: NJ31093 to the API
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:45:29Z',
 'fuel_type': 'petrol',
 'id': '9dcd5990-dc58-5159-9e16-8167e7bda145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ31093',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 181368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-21',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Saving data for NJ31093: {'auction_closing_time': 1774885529.0, 'created_time': 1774724498.998722, 'last_price_update_time': 1774847140.906734}
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ31093') HTTP/1.1" 204 0
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Scrape type for YZ13462: 0
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Scrape type for LE06198: 0
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-30 05:05:40 [auto1.nl] INFO: Scrape type for HW32084: 0
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-30 05:05:40 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for EW29368: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for UW56966: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for YF94322: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for PK76759: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for GA63942: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for XH80509: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for ND88147: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for WE18316: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for SS74343: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for YZ60467: 0
2026-03-30 05:05:41 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-30 05:05:41 [auto1.nl] INFO: Scrape type for MZ09465: 0
2026-03-30 05:06:12 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 1 pages/min), scraped 103 items (at 9 items/min)
2026-03-30 05:06:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-30 05:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:06:46 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 758 | hits on page: 40
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for EG04578: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for PJ49676: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for TL29950: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for GZ48867: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for ZB71006: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for DU11939: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for KK51574: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for AK27162: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for KX15971: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for MV10901: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for ZT51900: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for GN27243: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for NU66962: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for VY08351: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for XR71865: 0
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-30 05:06:46 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-30 05:06:46 [auto1.nl] INFO: Scrape type for YA06880: 0
2026-03-30 05:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:06:50 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 758 | hits on page: 40
2026-03-30 05:06:50 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-30 05:06:50 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for SE60245: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for KL38892: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for TW61693: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for SE95402: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for RK78214: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for EW45242: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for UA80107: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for UH76205: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for KX92525: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for UU92994: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for WY17438: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for ZS54708: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for BB32456: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for WW25859: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for BP52845: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for DX51815: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for NJ12224: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for DJ46393: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for JF84007: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for KD48941: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for EU38085: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for WN94746: 0
2026-03-30 05:06:51 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-30 05:06:51 [auto1.nl] INFO: Scrape type for WU56616: 0
2026-03-30 05:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:06:59 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 758 | hits on page: 38
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for CT48510: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for RD76922: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for WC26387: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for LF00808: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for JM92964: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for HJ37238: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for JK34334: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for YB88576: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for YG37971: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-30 05:06:59 [auto1.nl] INFO: Scrape type for UF88780: 0
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-30 05:06:59 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-30 05:07:00 [auto1.nl] INFO: Scrape type for KC88699: 0
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-30 05:07:00 [auto1.nl] INFO: Scrape type for WZ79997: 0
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-30 05:07:00 [auto1.nl] INFO: Scrape type for MP39959: 0
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-30 05:07:00 [auto1.nl] INFO: Scrape type for YN95467: 0
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-30 05:07:00 [auto1.nl] INFO: Scrape type for AW17903: 0
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-30 05:07:00 [auto1.nl] INFO: Scrape type for NC22018: 0
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-30 05:07:00 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-30 05:07:00 [auto1.nl] INFO: Scrape type for ZG49112: 0
2026-03-30 05:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:07:01 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 758 | hits on page: 0
2026-03-30 05:07:01 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 05:07:01 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-30 05:07:01 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 71, <ScrapeType.BATCH_SKIPPED: 5>: 73}
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774415221 HTTP/1.1" 200 None
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AP35205') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AT11400') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW29218') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AZ38578') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD15993') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BH15545') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM14200') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM67035') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY88635') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF07773') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CG39960') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CG49570') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ15384') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM56886') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CU46217') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA38139') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF61090') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DL20657') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DL58681') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DP86632') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DV69075') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB43304') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ03630') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK37526') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK69349') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EL98159') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EN91803') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ER66811') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ET61539') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE72141') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FY11805') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GB25488') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GG31477') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GG84538') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GM91378') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN61312') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GP89606') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV75117') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW44426') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW58212') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GZ35195') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HP64030') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HS79254') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW62956') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX28809') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG65435') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK44728') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KE17571') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP69146') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP82395') HTTP/1.1" 204 0
2026-03-30 05:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KT94650') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV63077') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ61081') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LK80124') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW41678') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MA87282') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB01283') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB41781') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MC28548') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MC95226') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD37173') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MJ85496') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML39469') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MS63212') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MS88690') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MT38963') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA70537') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NC11102') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NG98573') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NN53717') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY01079') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PV81861') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PV91456') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RK02817') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RP03468') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RP29241') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RW22373') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA52477') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SH50286') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SN31713') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TF66537') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TJ80849') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN96391') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP11122') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU87868') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TZ30530') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF77212') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UG49724') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UL36219') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UN12627') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UV88471') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VE90401') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VF99410') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VK57088') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL80786') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VR62162') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VU22394') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW25358') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VZ32305') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VZ64428') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WE67687') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG88878') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WJ12146') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WX60039') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY66549') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ36474') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW84582') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YA58537') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YJ48979') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YL68168') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YR60959') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU62041') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YX18803') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE95377') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZM93995') HTTP/1.1" 204 0
2026-03-30 05:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZW90335') HTTP/1.1" 204 0
2026-03-30 05:07:02 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (103 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-30T05_00_00.jl
2026-03-30 05:07:02 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 64184,
 'downloader/request_count': 24,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 22,
 'downloader/response_bytes': 3430047,
 'downloader/response_count': 24,
 'downloader/response_status_count/200': 24,
 'elapsed_time_seconds': 410.648232,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 5, 7, 2, 668041, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 103,
 'log_count/DEBUG': 1732,
 'log_count/INFO': 2109,
 'memusage/max': 162906112,
 'memusage/startup': 147701760,
 'request_depth_max': 23,
 'response_received_count': 24,
 'scheduler/dequeued': 24,
 'scheduler/dequeued/memory': 24,
 'scheduler/enqueued': 24,
 'scheduler/enqueued/memory': 24,
 'scrape_type/batch_skipped': 396,
 'scrape_type/price_update': 103,
 'scrape_type/skipped': 299,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 25,
 'scrapy-zyte-api/error_ratio': 0.04,
 'scrapy-zyte-api/errors': 1,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 1,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 10.45284067548346,
 'scrapy-zyte-api/mean_response_seconds': 10.576547607236233,
 'scrapy-zyte-api/processed': 24,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 24,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 23,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 24,
 'scrapy-zyte-api/request_args/httpRequestBody': 22,
 'scrapy-zyte-api/request_args/httpRequestMethod': 22,
 'scrapy-zyte-api/request_args/httpResponseBody': 24,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 24,
 'scrapy-zyte-api/request_args/sessionContext': 24,
 'scrapy-zyte-api/request_args/url': 24,
 'scrapy-zyte-api/status_codes/0': 1,
 'scrapy-zyte-api/status_codes/200': 24,
 'scrapy-zyte-api/success': 24,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 798,
 'source/total_available': 758,
 'start_time': datetime.datetime(2026, 3, 30, 5, 0, 12, 19809, tzinfo=datetime.timezone.utc)}
2026-03-30 05:07:02 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 05:07:02 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f031cc86010>
2026-03-30 05:07:02 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f031cc863d0>