2026-03-29 19:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 19:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 19:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-29 19:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-29 19:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 19:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 19:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 19:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 19:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: 7a8e0072ba30d55d
2026-03-29 19:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 19:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-29T19_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 19:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 19:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 19:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 19:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 19:00:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 19:00:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 19:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 19:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-29 19:00:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 19:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 19:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 19:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 19:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 19:00:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 19:00:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 19:00:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 19:00:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 19:00:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 19:00:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-29 19:00:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 19:00:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 19:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 19:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 19:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 19:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 19:00:17 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for DA42701: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for WC63917: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for HK88309: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for FB29349: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for TM57044: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for NG83103: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for MW44280: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for BN75332: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-29 19:00:17 [auto1.nl] INFO: Scrape type for DW37625: 0
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-29 19:00:17 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-29 19:00:18 [auto1.nl] INFO: Scrape type for CE26691: 0
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-29 19:00:18 [auto1.nl] INFO: Scrape type for GR22460: 0
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-29 19:00:18 [auto1.nl] INFO: Scrape type for WM06162: 0
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-29 19:00:18 [auto1.nl] INFO: Scrape type for CP88423: 0
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-29 19:00:18 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-29 19:00:18 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-29 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:19 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for DA42701: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for WC63917: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for HK88309: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for FB29349: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for TM57044: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for NG83103: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for MW44280: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for BN75332: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for DW37625: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for CE26691: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for GR22460: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-29 19:00:19 [auto1.nl] INFO: Scrape type for WM06162: 0
2026-03-29 19:00:19 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-29 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-29 19:00:20 [auto1.nl] INFO: Scrape type for CP88423: 0
2026-03-29 19:00:20 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-29 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-29 19:00:20 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-29 19:00:20 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-29 19:00:20 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-29 19:00:20 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-29 19:00:20 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-29 19:00:20 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-29 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:21 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for FW01389: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE59902%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for UE59902: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for DS12539: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH12020%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for LH12020: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for JF28004: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for ZE22789: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for LW17731: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for YE49757: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU83484%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for XU83484: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for AJ89396: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for MW67597: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS28591%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for SS28591: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ12615%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for DJ12615: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS78045%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for FS78045: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF33290%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for FF33290: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for MB43165: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK68166%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for DK68166: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-29 19:00:21 [auto1.nl] INFO: Scrape type for WM74497: 0
2026-03-29 19:00:21 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-29 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:23 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS47079%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for PS47079: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV31817%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for EV31817: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH55431%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for KH55431: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG10969%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for EG10969: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for RC67109: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE96226%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for KE96226: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW61331%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for VW61331: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for DF82688: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE71777%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for UE71777: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for HV97203: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for UC71604: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for HF10176: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG79878%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for UG79878: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for RL18676: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for FD60498: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW54855%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for GW54855: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for XJ86601: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for FT93592: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT87192%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for TT87192: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for EP75091: 0
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-29 19:00:23 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-29 19:00:23 [auto1.nl] INFO: Scrape type for PT29526: 0
2026-03-29 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:24 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:24 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-29 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-29 19:00:24 [auto1.nl] INFO: Scrape type for LT58475: 2
2026-03-29 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4c28d85-2f83-5beb-a179-ecca40c5152b with identifier: LT58475
2026-03-29 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4c28d85-2f83-5beb-a179-ecca40c5152b with scrape type 2
2026-03-29 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4c28d85-2f83-5beb-a179-ecca40c5152b with scrape type 2
2026-03-29 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4c28d85-2f83-5beb-a179-ecca40c5152b, identifier: LT58475
2026-03-29 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4c28d85-2f83-5beb-a179-ecca40c5152b with identifier: LT58475
2026-03-29 19:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4c28d85-2f83-5beb-a179-ecca40c5152b with identifier: LT58475
2026-03-29 19:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4c28d85-2f83-5beb-a179-ecca40c5152b with identifier: LT58475 to the API
2026-03-29 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:33:24Z',
 'fuel_type': 'diesel',
 'id': 'e4c28d85-2f83-5beb-a179-ecca40c5152b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT58475',
 'listing': 'auction',
 'make': 'Saab',
 'model': '9-5',
 'odometer': 566783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-21',
 'seller_name': None,
 'title': 'Saab 9-5 2.2 TiD ARC',
 'transmission': 'automatic',
 'trim': 'ARC',
 'year': 2004}
2026-03-29 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-29 19:00:26 [auto1.nl] INFO: Saving data for LT58475: {'auction_closing_time': 1774884804.0, 'created_time': 1774724423.641637, 'last_price_update_time': 1774810826.940299}
2026-03-29 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT58475') HTTP/1.1" 204 0
2026-03-29 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:27 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-29 19:00:27 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-29 19:00:27 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-29 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-29 19:00:27 [auto1.nl] INFO: Scrape type for ZU81802: 0
2026-03-29 19:00:27 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-29 19:00:27 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-29 19:00:27 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-29 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-29 19:00:27 [auto1.nl] INFO: Scrape type for HT85176: 2
2026-03-29 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-29 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with scrape type 2
2026-03-29 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with scrape type 2
2026-03-29 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e8f5641-8913-59fc-a07d-53b1cce8ef56, identifier: HT85176
2026-03-29 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-29 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-29 19:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176 to the API
2026-03-29 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:20:13Z',
 'fuel_type': 'diesel',
 'id': '0e8f5641-8913-59fc-a07d-53b1cce8ef56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT85176',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 212515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-17',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 SDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2008}
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-29 19:00:28 [auto1.nl] INFO: Saving data for HT85176: {'auction_closing_time': 1774884013.0, 'created_time': 1774526497.839594, 'last_price_update_time': 1774810828.663144}
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT85176') HTTP/1.1" 204 0
2026-03-29 19:00:28 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-29 19:00:28 [auto1.nl] INFO: Scrape type for AR18023: 0
2026-03-29 19:00:28 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-29 19:00:28 [auto1.nl] INFO: Scrape type for VV23298: 2
2026-03-29 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with identifier: VV23298
2026-03-29 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with scrape type 2
2026-03-29 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with scrape type 2
2026-03-29 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7cb7b06f-3e71-578a-b5c2-3f3e01508065, identifier: VV23298
2026-03-29 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with identifier: VV23298
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with identifier: VV23298
2026-03-29 19:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7cb7b06f-3e71-578a-b5c2-3f3e01508065 with identifier: VV23298 to the API
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'petrol',
 'id': '7cb7b06f-3e71-578a-b5c2-3f3e01508065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV23298',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 110320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-03',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-29 19:00:29 [auto1.nl] INFO: Saving data for VV23298: {'auction_closing_time': 1774883596.0, 'created_time': 1773428627.268047, 'last_price_update_time': 1774810829.822391}
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VV23298') HTTP/1.1" 204 0
2026-03-29 19:00:29 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-29 19:00:29 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-29 19:00:29 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-29 19:00:29 [auto1.nl] INFO: Scrape type for TA68954: 2
2026-03-29 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3d831a-7ba3-50d8-b396-9761e3075c13 with identifier: TA68954
2026-03-29 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3d831a-7ba3-50d8-b396-9761e3075c13 with scrape type 2
2026-03-29 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3d831a-7ba3-50d8-b396-9761e3075c13 with scrape type 2
2026-03-29 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e3d831a-7ba3-50d8-b396-9761e3075c13, identifier: TA68954
2026-03-29 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e3d831a-7ba3-50d8-b396-9761e3075c13 with identifier: TA68954
2026-03-29 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e3d831a-7ba3-50d8-b396-9761e3075c13 with identifier: TA68954
2026-03-29 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e3d831a-7ba3-50d8-b396-9761e3075c13 with identifier: TA68954 to the API
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:24Z',
 'fuel_type': 'petrol',
 'id': '0e3d831a-7ba3-50d8-b396-9761e3075c13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA68954',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 215183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-21',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2014}
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-29 19:00:30 [auto1.nl] INFO: Saving data for TA68954: {'auction_closing_time': 1774885464.0, 'created_time': 1774724428.860796, 'last_price_update_time': 1774810830.432942}
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA68954') HTTP/1.1" 204 0
2026-03-29 19:00:30 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-29 19:00:30 [auto1.nl] INFO: Scrape type for MC92565: 0
2026-03-29 19:00:30 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-29 19:00:30 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-29 19:00:30 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-29 19:00:30 [auto1.nl] INFO: Scrape type for ML03692: 2
2026-03-29 19:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-29 19:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57604818-8aff-580a-8450-8d0c5b6addd5 with scrape type 2
2026-03-29 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57604818-8aff-580a-8450-8d0c5b6addd5 with scrape type 2
2026-03-29 19:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 57604818-8aff-580a-8450-8d0c5b6addd5, identifier: ML03692
2026-03-29 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-29 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692 to the API
2026-03-29 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:17:23Z',
 'fuel_type': 'petrol',
 'id': '57604818-8aff-580a-8450-8d0c5b6addd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML03692',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 153690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-24',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Active 2WD',
 'transmission': 'manual',
 'trim': 'Active 2WD',
 'year': 2006}
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-29 19:00:31 [auto1.nl] INFO: Saving data for ML03692: {'auction_closing_time': 1774883843.0, 'created_time': 1773343742.09665, 'last_price_update_time': 1774810831.395352}
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML03692') HTTP/1.1" 204 0
2026-03-29 19:00:31 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-29 19:00:31 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-29 19:00:31 [auto1.nl] INFO: Scrape type for KV65945: 2
2026-03-29 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-29 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with scrape type 2
2026-03-29 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with scrape type 2
2026-03-29 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd, identifier: KV65945
2026-03-29 19:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-29 19:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-29 19:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945 to the API
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:40:07Z',
 'fuel_type': 'petrol',
 'id': '9ce57fc6-21cb-5cf4-9505-b43c50982bfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV65945',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 241139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2018}
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-29 19:00:31 [auto1.nl] INFO: Saving data for KV65945: {'auction_closing_time': 1774885207.0, 'created_time': 1773134595.059007, 'last_price_update_time': 1774810831.996704}
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV65945') HTTP/1.1" 204 0
2026-03-29 19:00:32 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-29 19:00:32 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-29 19:00:32 [auto1.nl] INFO: Scrape type for EB25456: 2
2026-03-29 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-29 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa005e43-9bf0-537a-9aa4-5b8163c55914 with scrape type 2
2026-03-29 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa005e43-9bf0-537a-9aa4-5b8163c55914 with scrape type 2
2026-03-29 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa005e43-9bf0-537a-9aa4-5b8163c55914, identifier: EB25456
2026-03-29 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-29 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456 to the API
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'hybrid',
 'id': 'fa005e43-9bf0-537a-9aa4-5b8163c55914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB25456',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 178503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-29 19:00:32 [auto1.nl] INFO: Saving data for EB25456: {'auction_closing_time': 1774884768.0, 'created_time': 1774526446.091097, 'last_price_update_time': 1774810832.59291}
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB25456') HTTP/1.1" 204 0
2026-03-29 19:00:32 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-29 19:00:32 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-29 19:00:32 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-29 19:00:32 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-29 19:00:32 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-29 19:00:32 [auto1.nl] INFO: Scrape type for EY20513: 2
2026-03-29 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-29 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 277a7449-17f7-5d23-a41d-52df33e78d0d with scrape type 2
2026-03-29 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 277a7449-17f7-5d23-a41d-52df33e78d0d with scrape type 2
2026-03-29 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 277a7449-17f7-5d23-a41d-52df33e78d0d, identifier: EY20513
2026-03-29 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-29 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513 to the API
2026-03-29 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:41:52Z',
 'fuel_type': 'petrol',
 'id': '277a7449-17f7-5d23-a41d-52df33e78d0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY20513',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 125362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-24',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2008}
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-29 19:00:33 [auto1.nl] INFO: Saving data for EY20513: {'auction_closing_time': 1774885312.0, 'created_time': 1774612854.56335, 'last_price_update_time': 1774810833.215183}
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY20513') HTTP/1.1" 204 0
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-29 19:00:33 [auto1.nl] INFO: Scrape type for LX89920: 2
2026-03-29 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-29 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with scrape type 2
2026-03-29 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with scrape type 2
2026-03-29 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3, identifier: LX89920
2026-03-29 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-29 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920 to the API
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:26:45Z',
 'fuel_type': 'hybrid',
 'id': '03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX89920',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 51528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-29 19:00:33 [auto1.nl] INFO: Saving data for LX89920: {'auction_closing_time': 1774884405.0, 'created_time': 1774612906.852293, 'last_price_update_time': 1774810833.86204}
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX89920') HTTP/1.1" 204 0
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-29 19:00:33 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-29 19:00:33 [auto1.nl] INFO: Scrape type for UB57166: 2
2026-03-29 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-29 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 242474bf-1533-5340-8d9d-3ada2cd998ff with scrape type 2
2026-03-29 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 242474bf-1533-5340-8d9d-3ada2cd998ff with scrape type 2
2026-03-29 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 242474bf-1533-5340-8d9d-3ada2cd998ff, identifier: UB57166
2026-03-29 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-29 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-29 19:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166 to the API
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:27Z',
 'fuel_type': 'diesel',
 'id': '242474bf-1533-5340-8d9d-3ada2cd998ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB57166',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 184528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-05',
 'seller_name': None,
 'title': "Kia cee'd 1.4 CRDi Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2013}
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-29 19:00:34 [auto1.nl] INFO: Saving data for UB57166: {'auction_closing_time': 1774884687.0, 'created_time': 1773135283.127139, 'last_price_update_time': 1774810834.29107}
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB57166') HTTP/1.1" 204 0
2026-03-29 19:00:34 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-29 19:00:34 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-29 19:00:34 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-29 19:00:34 [auto1.nl] INFO: Scrape type for FB46775: 2
2026-03-29 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-29 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with scrape type 2
2026-03-29 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with scrape type 2
2026-03-29 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a680d4a3-dea7-5c80-9818-7e0b3b2ed048, identifier: FB46775
2026-03-29 19:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-29 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-29 19:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775 to the API
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:05:53Z',
 'fuel_type': 'hybrid',
 'id': 'a680d4a3-dea7-5c80-9818-7e0b3b2ed048',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB46775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 44926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-29 19:00:34 [auto1.nl] INFO: Saving data for FB46775: {'auction_closing_time': 1774883153.0, 'created_time': 1774292591.856896, 'last_price_update_time': 1774810834.781616}
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB46775') HTTP/1.1" 204 0
2026-03-29 19:00:34 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-29 19:00:34 [auto1.nl] INFO: Scrape type for HY50584: 2
2026-03-29 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-29 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with scrape type 2
2026-03-29 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with scrape type 2
2026-03-29 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed, identifier: HY50584
2026-03-29 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-29 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-29 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584 to the API
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:25:29Z',
 'fuel_type': 'hybrid',
 'id': 'a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY50584',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 129771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-04',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Flow',
 'transmission': 'automatic',
 'trim': 'Flow',
 'year': 2017}
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Saving data for HY50584: {'auction_closing_time': 1774884329.0, 'created_time': 1774612872.583904, 'last_price_update_time': 1774810835.325198}
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HY50584') HTTP/1.1" 204 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for ET47420: 0
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-29 19:00:35 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Scrape type for GS47094: 2
2026-03-29 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-29 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224473c8-ce88-5d83-939f-aac48135da14 with scrape type 2
2026-03-29 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224473c8-ce88-5d83-939f-aac48135da14 with scrape type 2
2026-03-29 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 224473c8-ce88-5d83-939f-aac48135da14, identifier: GS47094
2026-03-29 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-29 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-29 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094 to the API
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:45:10Z',
 'fuel_type': 'petrol',
 'id': '224473c8-ce88-5d83-939f-aac48135da14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS47094',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 104966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-29 19:00:35 [auto1.nl] INFO: Saving data for GS47094: {'auction_closing_time': 1774885510.0, 'created_time': 1773688145.394938, 'last_price_update_time': 1774810835.928607}
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS47094') HTTP/1.1" 204 0
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-29 19:00:36 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-29 19:00:36 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-29 19:00:36 [auto1.nl] INFO: Scrape type for FY76730: 2
2026-03-29 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-29 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with scrape type 2
2026-03-29 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with scrape type 2
2026-03-29 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 77c6191a-39c6-55cc-8e1b-5ef67fad3537, identifier: FY76730
2026-03-29 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-29 19:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730 to the API
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:45Z',
 'fuel_type': 'diesel',
 'id': '77c6191a-39c6-55cc-8e1b-5ef67fad3537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY76730',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 249210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-29 19:00:36 [auto1.nl] INFO: Saving data for FY76730: {'auction_closing_time': 1774886325.0, 'created_time': 1773131923.538821, 'last_price_update_time': 1774810836.785602}
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FY76730') HTTP/1.1" 204 0
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-29 19:00:36 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-29 19:00:36 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-29 19:00:36 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-29 19:00:36 [auto1.nl] INFO: Scrape type for LZ16255: 2
2026-03-29 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-29 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40131f07-463d-5f7f-807e-464c2c26bec6 with scrape type 2
2026-03-29 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40131f07-463d-5f7f-807e-464c2c26bec6 with scrape type 2
2026-03-29 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40131f07-463d-5f7f-807e-464c2c26bec6, identifier: LZ16255
2026-03-29 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-29 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-29 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255 to the API
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:10:38Z',
 'fuel_type': 'diesel',
 'id': '40131f07-463d-5f7f-807e-464c2c26bec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ16255',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 176051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L2 Pack Clim NAV',
 'transmission': 'manual',
 'trim': 'L2 Pack Clim NAV',
 'year': 2016}
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-29 19:00:37 [auto1.nl] INFO: Saving data for LZ16255: {'auction_closing_time': 1774883438.0, 'created_time': 1773134125.440572, 'last_price_update_time': 1774810837.251484}
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LZ16255') HTTP/1.1" 204 0
2026-03-29 19:00:37 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-29 19:00:37 [auto1.nl] INFO: Scrape type for TF89424: 2
2026-03-29 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-29 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46568cf-5996-58d7-b399-896c2a31ade2 with scrape type 2
2026-03-29 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46568cf-5996-58d7-b399-896c2a31ade2 with scrape type 2
2026-03-29 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c46568cf-5996-58d7-b399-896c2a31ade2, identifier: TF89424
2026-03-29 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-29 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-29 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424 to the API
2026-03-29 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:23:08Z',
 'fuel_type': 'petrol',
 'id': 'c46568cf-5996-58d7-b399-896c2a31ade2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF89424',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 147131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Audi A5 Sportback 1.8 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-29 19:00:38 [auto1.nl] INFO: Saving data for TF89424: {'auction_closing_time': 1774884188.0, 'created_time': 1773405907.997885, 'last_price_update_time': 1774810838.25339}
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TF89424') HTTP/1.1" 204 0
2026-03-29 19:00:38 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-29 19:00:38 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-29 19:00:38 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-29 19:00:38 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-29 19:00:38 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-29 19:00:38 [auto1.nl] INFO: Scrape type for RN50601: 2
2026-03-29 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-29 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da26612-6df4-597e-8da2-c3e32bde619a with scrape type 2
2026-03-29 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da26612-6df4-597e-8da2-c3e32bde619a with scrape type 2
2026-03-29 19:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4da26612-6df4-597e-8da2-c3e32bde619a, identifier: RN50601
2026-03-29 19:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-29 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-29 19:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601 to the API
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:32:36Z',
 'fuel_type': 'petrol',
 'id': '4da26612-6df4-597e-8da2-c3e32bde619a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN50601',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 103484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-29 19:00:38 [auto1.nl] INFO: Saving data for RN50601: {'auction_closing_time': 1774884756.0, 'created_time': 1774612891.78819, 'last_price_update_time': 1774810838.712427}
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RN50601') HTTP/1.1" 204 0
2026-03-29 19:00:38 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-29 19:00:38 [auto1.nl] INFO: Scrape type for YN14337: 2
2026-03-29 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-29 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb566f2-7ec2-5de5-8b5f-2d829148d758 with scrape type 2
2026-03-29 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffb566f2-7ec2-5de5-8b5f-2d829148d758 with scrape type 2
2026-03-29 19:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ffb566f2-7ec2-5de5-8b5f-2d829148d758, identifier: YN14337
2026-03-29 19:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-29 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-29 19:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337 to the API
2026-03-29 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:35:51Z',
 'fuel_type': 'petrol',
 'id': 'ffb566f2-7ec2-5de5-8b5f-2d829148d758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN14337',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 187042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2014}
2026-03-29 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-29 19:00:39 [auto1.nl] INFO: Saving data for YN14337: {'auction_closing_time': 1774884951.0, 'created_time': 1773134922.681851, 'last_price_update_time': 1774810839.235473}
2026-03-29 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN14337') HTTP/1.1" 204 0
2026-03-29 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:40 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-29 19:00:40 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-29 19:00:40 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-29 19:00:40 [auto1.nl] INFO: Scrape type for LG57021: 2
2026-03-29 19:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-29 19:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0862ad0-f3eb-504c-a902-f2ac95ab4200 with scrape type 2
2026-03-29 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0862ad0-f3eb-504c-a902-f2ac95ab4200 with scrape type 2
2026-03-29 19:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d0862ad0-f3eb-504c-a902-f2ac95ab4200, identifier: LG57021
2026-03-29 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-29 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-29 19:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021 to the API
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:33:34Z',
 'fuel_type': 'petrol',
 'id': 'd0862ad0-f3eb-504c-a902-f2ac95ab4200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG57021',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 156246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-16',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 240 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2003}
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-29 19:00:40 [auto1.nl] INFO: Saving data for LG57021: {'auction_closing_time': 1774884814.0, 'created_time': 1774612921.177823, 'last_price_update_time': 1774810840.642467}
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG57021') HTTP/1.1" 204 0
2026-03-29 19:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-29 19:00:40 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-29 19:00:40 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-29 19:00:40 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-29 19:00:40 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-29 19:00:40 [auto1.nl] INFO: Scrape type for VM45476: 2
2026-03-29 19:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with identifier: VM45476
2026-03-29 19:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with scrape type 2
2026-03-29 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with scrape type 2
2026-03-29 19:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5834ca94-a5e7-5a67-9ecb-5c757b878c10, identifier: VM45476
2026-03-29 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with identifier: VM45476
2026-03-29 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with identifier: VM45476
2026-03-29 19:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5834ca94-a5e7-5a67-9ecb-5c757b878c10 with identifier: VM45476 to the API
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-30T15:42:22Z',
 'fuel_type': 'hybrid',
 'id': '5834ca94-a5e7-5a67-9ecb-5c757b878c10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM45476',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 80148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P300e Hybrid R-Dynamic SE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE AWD',
 'year': 2021}
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-29 19:00:41 [auto1.nl] INFO: Saving data for VM45476: {'auction_closing_time': 1774885342.0, 'created_time': 1774292523.0696, 'last_price_update_time': 1774810841.109701}
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VM45476') HTTP/1.1" 204 0
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-29 19:00:41 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-29 19:00:41 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-29 19:00:41 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-29 19:00:41 [auto1.nl] INFO: Scrape type for RT28324: 2
2026-03-29 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-29 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30da8169-e641-50bf-af5a-57af04ba4990 with scrape type 2
2026-03-29 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30da8169-e641-50bf-af5a-57af04ba4990 with scrape type 2
2026-03-29 19:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30da8169-e641-50bf-af5a-57af04ba4990, identifier: RT28324
2026-03-29 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-29 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-29 19:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324 to the API
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:39Z',
 'fuel_type': 'petrol',
 'id': '30da8169-e641-50bf-af5a-57af04ba4990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT28324',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 50150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-05',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-29 19:00:41 [auto1.nl] INFO: Saving data for RT28324: {'auction_closing_time': 1774884819.0, 'created_time': 1774526506.285307, 'last_price_update_time': 1774810841.68052}
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT28324') HTTP/1.1" 204 0
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-29 19:00:41 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-29 19:00:41 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-29 19:00:41 [auto1.nl] INFO: Scrape type for MW16655: 2
2026-03-29 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-29 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a035ded3-6a3d-5870-8819-bb065735b37f with scrape type 2
2026-03-29 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a035ded3-6a3d-5870-8819-bb065735b37f with scrape type 2
2026-03-29 19:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a035ded3-6a3d-5870-8819-bb065735b37f, identifier: MW16655
2026-03-29 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-29 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-29 19:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655 to the API
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'petrol',
 'id': 'a035ded3-6a3d-5870-8819-bb065735b37f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW16655',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 55843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-17',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2010}
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Saving data for MW16655: {'auction_closing_time': 1774884291.0, 'created_time': 1774526487.240626, 'last_price_update_time': 1774810842.109372}
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW16655') HTTP/1.1" 204 0
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Scrape type for ET49040: 2
2026-03-29 19:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-29 19:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with scrape type 2
2026-03-29 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with scrape type 2
2026-03-29 19:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14436c4b-d70a-5d2f-9e2b-e80701a321d1, identifier: ET49040
2026-03-29 19:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-29 19:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-29 19:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040 to the API
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:40Z',
 'fuel_type': 'diesel',
 'id': '14436c4b-d70a-5d2f-9e2b-e80701a321d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET49040',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 158951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-10',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Saving data for ET49040: {'auction_closing_time': 1774884220.0, 'created_time': 1773921682.734775, 'last_price_update_time': 1774810842.70102}
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ET49040') HTTP/1.1" 204 0
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Scrape type for SE99372: 0
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-29 19:00:42 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-29 19:00:42 [auto1.nl] INFO: Scrape type for BZ34461: 2
2026-03-29 19:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-29 19:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d52b8792-fb43-5a09-aad8-ec4816df7017 with scrape type 2
2026-03-29 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d52b8792-fb43-5a09-aad8-ec4816df7017 with scrape type 2
2026-03-29 19:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d52b8792-fb43-5a09-aad8-ec4816df7017, identifier: BZ34461
2026-03-29 19:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-29 19:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-29 19:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461 to the API
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:59:21Z',
 'fuel_type': 'hybrid',
 'id': 'd52b8792-fb43-5a09-aad8-ec4816df7017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ34461',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 155516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-29 19:00:43 [auto1.nl] INFO: Saving data for BZ34461: {'auction_closing_time': 1774886361.0, 'created_time': 1774612912.421671, 'last_price_update_time': 1774810843.23284}
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ34461') HTTP/1.1" 204 0
2026-03-29 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:43 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:43 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-29 19:00:43 [auto1.nl] INFO: Scrape type for MY95801: 2
2026-03-29 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-29 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with scrape type 2
2026-03-29 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with scrape type 2
2026-03-29 19:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd, identifier: MY95801
2026-03-29 19:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-29 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-29 19:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801 to the API
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:59:01Z',
 'fuel_type': 'petrol',
 'id': 'fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY95801',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 85105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'BMW 5er 520i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-29 19:00:44 [auto1.nl] INFO: Saving data for MY95801: {'auction_closing_time': 1774886341.0, 'created_time': 1774526473.15677, 'last_price_update_time': 1774810844.065289}
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MY95801') HTTP/1.1" 204 0
2026-03-29 19:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-29 19:00:44 [auto1.nl] INFO: Scrape type for XV01386: 2
2026-03-29 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-29 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with scrape type 2
2026-03-29 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with scrape type 2
2026-03-29 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 584ceb9e-5605-5102-b1d0-e5ade31e20e9, identifier: XV01386
2026-03-29 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-29 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-29 19:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386 to the API
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:51Z',
 'fuel_type': 'petrol',
 'id': '584ceb9e-5605-5102-b1d0-e5ade31e20e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV01386',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 79518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-29 19:00:44 [auto1.nl] INFO: Saving data for XV01386: {'auction_closing_time': 1774882971.0, 'created_time': 1773774209.302946, 'last_price_update_time': 1774810844.548368}
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV01386') HTTP/1.1" 204 0
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-29 19:00:44 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-29 19:00:44 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-29 19:00:44 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-29 19:00:44 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-29 19:00:44 [auto1.nl] INFO: Scrape type for LD78562: 2
2026-03-29 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-29 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 with scrape type 2
2026-03-29 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 with scrape type 2
2026-03-29 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5727513d-93cb-5a28-a9c2-3deb89ee0476, identifier: LD78562
2026-03-29 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-29 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-29 19:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562 to the API
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:05:37Z',
 'fuel_type': 'petrol',
 'id': '5727513d-93cb-5a28-a9c2-3deb89ee0476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD78562',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 295518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-27',
 'seller_name': None,
 'title': 'Seat Leon 1.6 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-29 19:00:45 [auto1.nl] INFO: Saving data for LD78562: {'auction_closing_time': 1774883137.0, 'created_time': 1774001973.259294, 'last_price_update_time': 1774810845.0133}
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LD78562') HTTP/1.1" 204 0
2026-03-29 19:00:45 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-29 19:00:45 [auto1.nl] INFO: Scrape type for WD65994: 2
2026-03-29 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-29 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7339da98-f9dd-5833-ad9c-585f264bbece with scrape type 2
2026-03-29 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7339da98-f9dd-5833-ad9c-585f264bbece with scrape type 2
2026-03-29 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7339da98-f9dd-5833-ad9c-585f264bbece, identifier: WD65994
2026-03-29 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-29 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-29 19:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994 to the API
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:39:17Z',
 'fuel_type': 'petrol',
 'id': '7339da98-f9dd-5833-ad9c-585f264bbece',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD65994',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 263960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-09',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-29 19:00:45 [auto1.nl] INFO: Saving data for WD65994: {'auction_closing_time': 1774885157.0, 'created_time': 1773836967.795693, 'last_price_update_time': 1774810845.4554}
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WD65994') HTTP/1.1" 204 0
2026-03-29 19:00:45 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-29 19:00:45 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-29 19:00:45 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-29 19:00:45 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-29 19:00:45 [auto1.nl] INFO: Scrape type for NL71418: 2
2026-03-29 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-29 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with scrape type 2
2026-03-29 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with scrape type 2
2026-03-29 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963, identifier: NL71418
2026-03-29 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-29 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-29 19:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418 to the API
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:06:57Z',
 'fuel_type': 'petrol',
 'id': '7a4a1b86-6d0e-5cfd-8018-5fe9da422963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL71418',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 229363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-01',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Comfort',
 'transmission': 'automatic',
 'trim': 'Sport Comfort',
 'year': 2004}
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Saving data for NL71418: {'auction_closing_time': 1774883217.0, 'created_time': 1774612902.831196, 'last_price_update_time': 1774810846.019711}
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL71418') HTTP/1.1" 204 0
2026-03-29 19:00:46 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-29 19:00:46 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-29 19:00:46 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-29 19:00:46 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-29 19:00:46 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-29 19:00:46 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-29 19:00:46 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Scrape type for YW81523: 2
2026-03-29 19:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-29 19:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382aef13-4829-597e-9f28-b53e227c1782 with scrape type 2
2026-03-29 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382aef13-4829-597e-9f28-b53e227c1782 with scrape type 2
2026-03-29 19:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 382aef13-4829-597e-9f28-b53e227c1782, identifier: YW81523
2026-03-29 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-29 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-29 19:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523 to the API
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:43Z',
 'fuel_type': 'petrol',
 'id': '382aef13-4829-597e-9f28-b53e227c1782',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW81523',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 193516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Saving data for YW81523: {'auction_closing_time': 1774885123.0, 'created_time': 1774526430.613596, 'last_price_update_time': 1774810846.502178}
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YW81523') HTTP/1.1" 204 0
2026-03-29 19:00:46 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Scrape type for KK56723: 2
2026-03-29 19:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-29 19:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with scrape type 2
2026-03-29 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with scrape type 2
2026-03-29 19:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e6af16e-6a59-5bee-bde9-300e33c2eab8, identifier: KK56723
2026-03-29 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-29 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-29 19:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723 to the API
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'hybrid',
 'id': '2e6af16e-6a59-5bee-bde9-300e33c2eab8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK56723',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 154829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-19',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-29 19:00:46 [auto1.nl] INFO: Saving data for KK56723: {'auction_closing_time': 1774882938.0, 'created_time': 1774526479.770742, 'last_price_update_time': 1774810846.947052}
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KK56723') HTTP/1.1" 204 0
2026-03-29 19:00:47 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-29 19:00:47 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-29 19:00:47 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-29 19:00:47 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-29 19:00:47 [auto1.nl] INFO: Scrape type for UJ24113: 2
2026-03-29 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-29 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with scrape type 2
2026-03-29 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with scrape type 2
2026-03-29 19:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d, identifier: UJ24113
2026-03-29 19:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-29 19:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-29 19:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113 to the API
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:21:21Z',
 'fuel_type': 'petrol',
 'id': 'f8ba5787-5f2e-51ae-a90f-2f4e2a08607d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ24113',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 69078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-29 19:00:47 [auto1.nl] INFO: Saving data for UJ24113: {'auction_closing_time': 1774884081.0, 'created_time': 1774267367.165865, 'last_price_update_time': 1774810847.510703}
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ24113') HTTP/1.1" 204 0
2026-03-29 19:00:47 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-29 19:00:47 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-29 19:00:47 [auto1.nl] INFO: Scrape type for ZC66376: 2
2026-03-29 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-29 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e694759e-81bc-546a-b3b5-4a98c30a5836 with scrape type 2
2026-03-29 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e694759e-81bc-546a-b3b5-4a98c30a5836 with scrape type 2
2026-03-29 19:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e694759e-81bc-546a-b3b5-4a98c30a5836, identifier: ZC66376
2026-03-29 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-29 19:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-29 19:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376 to the API
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:05:16Z',
 'fuel_type': 'petrol',
 'id': 'e694759e-81bc-546a-b3b5-4a98c30a5836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC66376',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-29 19:00:47 [auto1.nl] INFO: Saving data for ZC66376: {'auction_closing_time': 1774883116.0, 'created_time': 1774612929.820288, 'last_price_update_time': 1774810847.931071}
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZC66376') HTTP/1.1" 204 0
2026-03-29 19:00:47 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-29 19:00:47 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-29 19:00:47 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-29 19:00:47 [auto1.nl] INFO: Scrape type for DF87411: 2
2026-03-29 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-29 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a460bdb-cac6-5457-88e8-45d0702eab76 with scrape type 2
2026-03-29 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a460bdb-cac6-5457-88e8-45d0702eab76 with scrape type 2
2026-03-29 19:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4a460bdb-cac6-5457-88e8-45d0702eab76, identifier: DF87411
2026-03-29 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-29 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-29 19:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411 to the API
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:14:21Z',
 'fuel_type': 'petrol',
 'id': '4a460bdb-cac6-5457-88e8-45d0702eab76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF87411',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 130172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-10',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-29 19:00:48 [auto1.nl] INFO: Saving data for DF87411: {'auction_closing_time': 1774883661.0, 'created_time': 1774526474.990101, 'last_price_update_time': 1774810848.344753}
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF87411') HTTP/1.1" 204 0
2026-03-29 19:00:48 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-29 19:00:48 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-29 19:00:48 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-29 19:00:48 [auto1.nl] INFO: Scrape type for HX69861: 2
2026-03-29 19:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-29 19:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with scrape type 2
2026-03-29 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with scrape type 2
2026-03-29 19:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 759c289a-6f1a-5c6d-a4c3-9cdd63597780, identifier: HX69861
2026-03-29 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-29 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-29 19:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861 to the API
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:52:24Z',
 'fuel_type': 'diesel',
 'id': '759c289a-6f1a-5c6d-a4c3-9cdd63597780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX69861',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 386924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC Avantgarde',
 'year': 2015}
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-29 19:00:48 [auto1.nl] INFO: Saving data for HX69861: {'auction_closing_time': 1774885944.0, 'created_time': 1774002003.933543, 'last_price_update_time': 1774810848.752346}
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX69861') HTTP/1.1" 204 0
2026-03-29 19:00:48 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:48 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-29 19:00:48 [auto1.nl] INFO: Scrape type for SD33545: 2
2026-03-29 19:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-29 19:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb68523d-d7ee-5239-af35-c043bb1fa1da with scrape type 2
2026-03-29 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb68523d-d7ee-5239-af35-c043bb1fa1da with scrape type 2
2026-03-29 19:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fb68523d-d7ee-5239-af35-c043bb1fa1da, identifier: SD33545
2026-03-29 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-29 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-29 19:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545 to the API
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:18Z',
 'fuel_type': 'petrol',
 'id': 'fb68523d-d7ee-5239-af35-c043bb1fa1da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD33545',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 111362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-29 19:00:49 [auto1.nl] INFO: Saving data for SD33545: {'auction_closing_time': 1774886238.0, 'created_time': 1774612919.676882, 'last_price_update_time': 1774810849.274793}
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD33545') HTTP/1.1" 204 0
2026-03-29 19:00:49 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-29 19:00:49 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-29 19:00:49 [auto1.nl] INFO: Scrape type for JC35078: 2
2026-03-29 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-29 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with scrape type 2
2026-03-29 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with scrape type 2
2026-03-29 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af, identifier: JC35078
2026-03-29 19:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:49 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-29 19:00:49 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-29 19:00:49 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-29 19:00:49 [auto1.nl] INFO: Scrape type for VA79192: 2
2026-03-29 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-29 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with scrape type 2
2026-03-29 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with scrape type 2
2026-03-29 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1, identifier: VA79192
2026-03-29 19:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-29 19:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-29 19:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078 to the API
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:37:35Z',
 'fuel_type': 'petrol',
 'id': '83c358ee-d5b0-5bbc-8153-04a51ec4c1af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC35078',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 135975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2015}
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-29 19:00:49 [auto1.nl] INFO: Saving data for JC35078: {'auction_closing_time': 1774885055.0, 'created_time': 1774612875.200698, 'last_price_update_time': 1774810849.824182}
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC35078') HTTP/1.1" 204 0
2026-03-29 19:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-29 19:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-29 19:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192 to the API
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:33:39Z',
 'fuel_type': 'petrol',
 'id': '95553b68-c4db-5f63-a7c4-4af85e2cc2c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA79192',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 59094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2014}
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-29 19:00:50 [auto1.nl] INFO: Saving data for VA79192: {'auction_closing_time': 1774884819.0, 'created_time': 1774526494.338331, 'last_price_update_time': 1774810850.098226}
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA79192') HTTP/1.1" 204 0
2026-03-29 19:00:50 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-29 19:00:50 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-29 19:00:50 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-29 19:00:50 [auto1.nl] INFO: Scrape type for WH69219: 2
2026-03-29 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-29 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82f516b-5659-5a1c-8ac5-9da25e80afaa with scrape type 2
2026-03-29 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c82f516b-5659-5a1c-8ac5-9da25e80afaa with scrape type 2
2026-03-29 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c82f516b-5659-5a1c-8ac5-9da25e80afaa, identifier: WH69219
2026-03-29 19:00:50 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-29 19:00:50 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-29 19:00:50 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-29 19:00:50 [auto1.nl] INFO: Scrape type for DK58919: 2
2026-03-29 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-29 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c3fcff-a822-538d-96be-9ad21dd66132 with scrape type 2
2026-03-29 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c3fcff-a822-538d-96be-9ad21dd66132 with scrape type 2
2026-03-29 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78c3fcff-a822-538d-96be-9ad21dd66132, identifier: DK58919
2026-03-29 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-29 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-29 19:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219 to the API
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:29:05Z',
 'fuel_type': 'hybrid',
 'id': 'c82f516b-5659-5a1c-8ac5-9da25e80afaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH69219',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 254498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-29 19:00:50 [auto1.nl] INFO: Saving data for WH69219: {'auction_closing_time': 1774884545.0, 'created_time': 1774612920.729176, 'last_price_update_time': 1774810850.646002}
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WH69219') HTTP/1.1" 204 0
2026-03-29 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-29 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-29 19:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919 to the API
2026-03-29 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:58:17Z',
 'fuel_type': 'diesel',
 'id': '78c3fcff-a822-538d-96be-9ad21dd66132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK58919',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 171371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-15',
 'seller_name': None,
 'title': 'Opel Vivaro 1.9 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2003}
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-29 19:00:51 [auto1.nl] INFO: Saving data for DK58919: {'auction_closing_time': 1774886297.0, 'created_time': 1773231838.862376, 'last_price_update_time': 1774810851.748292}
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK58919') HTTP/1.1" 204 0
2026-03-29 19:00:51 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-29 19:00:51 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-29 19:00:51 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-29 19:00:51 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-29 19:00:51 [auto1.nl] INFO: Scrape type for FU31497: 2
2026-03-29 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-29 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with scrape type 2
2026-03-29 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with scrape type 2
2026-03-29 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c, identifier: FU31497
2026-03-29 19:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-29 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-29 19:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497 to the API
2026-03-29 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:29Z',
 'fuel_type': 'petrol',
 'id': '6296cd2c-5077-56d2-a288-7c9dc3d0df5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU31497',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 101593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-29 19:00:52 [auto1.nl] INFO: Saving data for FU31497: {'auction_closing_time': 1774885949.0, 'created_time': 1774612911.617417, 'last_price_update_time': 1774810852.208058}
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FU31497') HTTP/1.1" 204 0
2026-03-29 19:00:52 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-29 19:00:52 [auto1.nl] INFO: Scrape type for NV42843: 2
2026-03-29 19:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-29 19:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14aed98b-74ab-5de5-987c-17d9cafc2f45 with scrape type 2
2026-03-29 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14aed98b-74ab-5de5-987c-17d9cafc2f45 with scrape type 2
2026-03-29 19:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14aed98b-74ab-5de5-987c-17d9cafc2f45, identifier: NV42843
2026-03-29 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-29 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-29 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843 to the API
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:58:32Z',
 'fuel_type': 'petrol',
 'id': '14aed98b-74ab-5de5-987c-17d9cafc2f45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV42843',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 194299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-29 19:00:52 [auto1.nl] INFO: Saving data for NV42843: {'auction_closing_time': 1774886312.0, 'created_time': 1773946977.983496, 'last_price_update_time': 1774810852.653731}
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NV42843') HTTP/1.1" 204 0
2026-03-29 19:00:52 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-29 19:00:52 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-29 19:00:52 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-29 19:00:52 [auto1.nl] INFO: Scrape type for VA70092: 2
2026-03-29 19:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-29 19:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d2af2a-6313-5974-93fa-2234f5bbc454 with scrape type 2
2026-03-29 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d2af2a-6313-5974-93fa-2234f5bbc454 with scrape type 2
2026-03-29 19:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6d2af2a-6313-5974-93fa-2234f5bbc454, identifier: VA70092
2026-03-29 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-29 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-29 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092 to the API
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:30:38Z',
 'fuel_type': 'petrol',
 'id': 'e6d2af2a-6313-5974-93fa-2234f5bbc454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA70092',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 97682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-29 19:00:53 [auto1.nl] INFO: Saving data for VA70092: {'auction_closing_time': 1774884638.0, 'created_time': 1773946982.168265, 'last_price_update_time': 1774810853.107989}
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA70092') HTTP/1.1" 204 0
2026-03-29 19:00:53 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-29 19:00:53 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-29 19:00:53 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-29 19:00:53 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-29 19:00:53 [auto1.nl] INFO: Scrape type for ZX63291: 2
2026-03-29 19:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-29 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b713f838-6685-5d90-b854-e23da1bc833d with scrape type 2
2026-03-29 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b713f838-6685-5d90-b854-e23da1bc833d with scrape type 2
2026-03-29 19:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b713f838-6685-5d90-b854-e23da1bc833d, identifier: ZX63291
2026-03-29 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-29 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-29 19:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291 to the API
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:23:28Z',
 'fuel_type': 'petrol',
 'id': 'b713f838-6685-5d90-b854-e23da1bc833d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX63291',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 128430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 THP Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2017}
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-29 19:00:53 [auto1.nl] INFO: Saving data for ZX63291: {'auction_closing_time': 1774884208.0, 'created_time': 1774612901.721575, 'last_price_update_time': 1774810853.539397}
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZX63291') HTTP/1.1" 204 0
2026-03-29 19:00:53 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-29 19:00:53 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-29 19:00:53 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-29 19:00:53 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-29 19:00:53 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-29 19:00:53 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-29 19:00:53 [auto1.nl] INFO: Scrape type for MJ47722: 2
2026-03-29 19:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-29 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08dc3162-687d-561c-8a0f-a64e30ae2351 with scrape type 2
2026-03-29 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08dc3162-687d-561c-8a0f-a64e30ae2351 with scrape type 2
2026-03-29 19:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08dc3162-687d-561c-8a0f-a64e30ae2351, identifier: MJ47722
2026-03-29 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-29 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-29 19:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722 to the API
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'petrol',
 'id': '08dc3162-687d-561c-8a0f-a64e30ae2351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ47722',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 262393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-08',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-29 19:00:53 [auto1.nl] INFO: Saving data for MJ47722: {'auction_closing_time': 1774885164.0, 'created_time': 1774526463.278356, 'last_price_update_time': 1774810853.989453}
2026-03-29 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MJ47722') HTTP/1.1" 204 0
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-29 19:00:54 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-29 19:00:54 [auto1.nl] INFO: Scrape type for JT64166: 2
2026-03-29 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-29 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c88a9e-c5b7-5075-867a-5a21665e2328 with scrape type 2
2026-03-29 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c88a9e-c5b7-5075-867a-5a21665e2328 with scrape type 2
2026-03-29 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 82c88a9e-c5b7-5075-867a-5a21665e2328, identifier: JT64166
2026-03-29 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-29 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-29 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166 to the API
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:11Z',
 'fuel_type': 'petrol',
 'id': '82c88a9e-c5b7-5075-867a-5a21665e2328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT64166',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 209817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2015}
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-29 19:00:54 [auto1.nl] INFO: Saving data for JT64166: {'auction_closing_time': 1774884251.0, 'created_time': 1774526484.730215, 'last_price_update_time': 1774810854.524259}
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JT64166') HTTP/1.1" 204 0
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-29 19:00:54 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-29 19:00:54 [auto1.nl] INFO: Scrape type for XA85497: 2
2026-03-29 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-29 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 105ffac9-32f7-5baf-a4dc-41031fe00db7 with scrape type 2
2026-03-29 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 105ffac9-32f7-5baf-a4dc-41031fe00db7 with scrape type 2
2026-03-29 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 105ffac9-32f7-5baf-a4dc-41031fe00db7, identifier: XA85497
2026-03-29 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-29 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-29 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497 to the API
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:17:28Z',
 'fuel_type': 'diesel',
 'id': '105ffac9-32f7-5baf-a4dc-41031fe00db7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA85497',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 280658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum Business 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Business 2WD',
 'year': 2015}
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Saving data for XA85497: {'auction_closing_time': 1774883848.0, 'created_time': 1773135052.806749, 'last_price_update_time': 1774810855.059121}
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XA85497') HTTP/1.1" 204 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for WS29354: 2
2026-03-29 19:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-29 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1fa8f90-f881-58b0-ab46-6f3480823f82 with scrape type 2
2026-03-29 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1fa8f90-f881-58b0-ab46-6f3480823f82 with scrape type 2
2026-03-29 19:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1fa8f90-f881-58b0-ab46-6f3480823f82, identifier: WS29354
2026-03-29 19:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-29 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-29 19:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354 to the API
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:00:10Z',
 'fuel_type': 'hybrid',
 'id': 'c1fa8f90-f881-58b0-ab46-6f3480823f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS29354',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 100541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Inscription Expression AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression AWD',
 'year': 2019}
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Saving data for WS29354: {'auction_closing_time': 1774882810.0, 'created_time': 1773514874.68678, 'last_price_update_time': 1774810855.555365}
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS29354') HTTP/1.1" 204 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-29 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:55 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-29 19:00:55 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-29 19:00:55 [auto1.nl] INFO: Scrape type for FR87941: 2
2026-03-29 19:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-29 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with scrape type 2
2026-03-29 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with scrape type 2
2026-03-29 19:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3, identifier: FR87941
2026-03-29 19:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-29 19:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-29 19:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941 to the API
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:18:50Z',
 'fuel_type': 'petrol',
 'id': '69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR87941',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 117577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-29 19:00:56 [auto1.nl] INFO: Saving data for FR87941: {'auction_closing_time': 1774883930.0, 'created_time': 1774526508.124505, 'last_price_update_time': 1774810856.196045}
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR87941') HTTP/1.1" 204 0
2026-03-29 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-29 19:00:56 [auto1.nl] INFO: Scrape type for SX81397: 2
2026-03-29 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-29 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with scrape type 2
2026-03-29 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with scrape type 2
2026-03-29 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657, identifier: SX81397
2026-03-29 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-29 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-29 19:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397 to the API
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:46:32Z',
 'fuel_type': 'diesel',
 'id': '0b1aff7c-92ee-5b89-a34a-fcb0810c6657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX81397',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 195017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten Hochdach lang 4Motion',
 'transmission': 'automatic',
 'trim': 'Kasten Hochdach lang 4Motion',
 'year': 2017}
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-29 19:00:56 [auto1.nl] INFO: Saving data for SX81397: {'auction_closing_time': 1774885592.0, 'created_time': 1773232031.892876, 'last_price_update_time': 1774810856.718316}
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX81397') HTTP/1.1" 204 0
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-29 19:00:56 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-29 19:00:56 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-29 19:00:56 [auto1.nl] INFO: Scrape type for TU10821: 2
2026-03-29 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-29 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with scrape type 2
2026-03-29 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with scrape type 2
2026-03-29 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5, identifier: TU10821
2026-03-29 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-29 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-29 19:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821 to the API
2026-03-29 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:09:22Z',
 'fuel_type': 'hybrid',
 'id': 'f612b92c-ca6f-5c6b-9312-41fbdee5d4a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU10821',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 156841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-29 19:00:57 [auto1.nl] INFO: Saving data for TU10821: {'auction_closing_time': 1774883362.0, 'created_time': 1774612922.618508, 'last_price_update_time': 1774810857.184552}
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU10821') HTTP/1.1" 204 0
2026-03-29 19:00:57 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-29 19:00:57 [auto1.nl] INFO: Scrape type for ZD26534: 2
2026-03-29 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-29 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with scrape type 2
2026-03-29 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with scrape type 2
2026-03-29 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9, identifier: ZD26534
2026-03-29 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-29 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534 to the API
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-30T15:24:12Z',
 'fuel_type': 'petrol',
 'id': 'b55b8a52-4a17-50e8-bf86-3bbf8f9513e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD26534',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 88154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-03-31',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Privilege',
 'transmission': 'automatic',
 'trim': 'Privilege',
 'year': 2001}
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-29 19:00:57 [auto1.nl] INFO: Saving data for ZD26534: {'auction_closing_time': 1774884252.0, 'created_time': 1774119703.372047, 'last_price_update_time': 1774810857.966512}
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZD26534') HTTP/1.1" 204 0
2026-03-29 19:00:57 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-29 19:00:57 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-29 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-29 19:00:58 [auto1.nl] INFO: Scrape type for TY61758: 2
2026-03-29 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-29 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with scrape type 2
2026-03-29 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with scrape type 2
2026-03-29 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0aeef802-f18a-50ad-bb65-7b97acd5ae62, identifier: TY61758
2026-03-29 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-29 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-29 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758 to the API
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-30T15:25:57Z',
 'fuel_type': 'petrol',
 'id': '0aeef802-f18a-50ad-bb65-7b97acd5ae62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY61758',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 198388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-20',
 'seller_name': None,
 'title': 'Audi S6 5.2 V10 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-29 19:00:58 [auto1.nl] INFO: Saving data for TY61758: {'auction_closing_time': 1774884357.0, 'created_time': 1774612910.645523, 'last_price_update_time': 1774810858.48844}
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TY61758') HTTP/1.1" 204 0
2026-03-29 19:00:58 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-29 19:00:58 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-29 19:00:58 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-29 19:00:58 [auto1.nl] INFO: Scrape type for PG46787: 2
2026-03-29 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-29 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f with scrape type 2
2026-03-29 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f with scrape type 2
2026-03-29 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f665fc60-c58f-5fd6-96ed-ce77a307ed1f, identifier: PG46787
2026-03-29 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-29 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-29 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787 to the API
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:56:51Z',
 'fuel_type': 'petrol',
 'id': 'f665fc60-c58f-5fd6-96ed-ce77a307ed1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG46787',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 51364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Intense',
 'transmission': 'automatic',
 'trim': 'Intense',
 'year': 2011}
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-29 19:00:58 [auto1.nl] INFO: Saving data for PG46787: {'auction_closing_time': 1774886211.0, 'created_time': 1774612931.822116, 'last_price_update_time': 1774810858.880967}
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PG46787') HTTP/1.1" 204 0
2026-03-29 19:00:58 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-29 19:00:58 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-29 19:00:58 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-29 19:00:58 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-29 19:00:58 [auto1.nl] INFO: Scrape type for CG77801: 2
2026-03-29 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-29 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d12a5345-0774-5d5d-8419-10744b816bf5 with scrape type 2
2026-03-29 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d12a5345-0774-5d5d-8419-10744b816bf5 with scrape type 2
2026-03-29 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d12a5345-0774-5d5d-8419-10744b816bf5, identifier: CG77801
2026-03-29 19:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-29 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-29 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801 to the API
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:05:24Z',
 'fuel_type': 'diesel',
 'id': 'd12a5345-0774-5d5d-8419-10744b816bf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG77801',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 214505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.3 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-29 19:00:59 [auto1.nl] INFO: Saving data for CG77801: {'auction_closing_time': 1774883124.0, 'created_time': 1773134959.801317, 'last_price_update_time': 1774810859.328925}
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CG77801') HTTP/1.1" 204 0
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-29 19:00:59 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-29 19:00:59 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-29 19:00:59 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-29 19:00:59 [auto1.nl] INFO: Scrape type for XW28642: 2
2026-03-29 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5f08860-8802-5c0a-9533-607799279a29 with identifier: XW28642
2026-03-29 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f08860-8802-5c0a-9533-607799279a29 with scrape type 2
2026-03-29 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5f08860-8802-5c0a-9533-607799279a29 with scrape type 2
2026-03-29 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a5f08860-8802-5c0a-9533-607799279a29, identifier: XW28642
2026-03-29 19:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a5f08860-8802-5c0a-9533-607799279a29 with identifier: XW28642
2026-03-29 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a5f08860-8802-5c0a-9533-607799279a29 with identifier: XW28642
2026-03-29 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a5f08860-8802-5c0a-9533-607799279a29 with identifier: XW28642 to the API
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:01:02Z',
 'fuel_type': 'petrol',
 'id': 'a5f08860-8802-5c0a-9533-607799279a29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW28642',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 242245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-13',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-29 19:00:59 [auto1.nl] INFO: Saving data for XW28642: {'auction_closing_time': 1774882862.0, 'created_time': 1774724456.08019, 'last_price_update_time': 1774810859.780059}
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW28642') HTTP/1.1" 204 0
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-29 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:00:59 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 758 | hits on page: 40
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-29 19:00:59 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-29 19:01:00 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-29 19:01:00 [auto1.nl] INFO: Scrape type for MU53685: 2
2026-03-29 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-29 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6216bfca-7290-5e92-9d40-7f8f23485812 with scrape type 2
2026-03-29 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6216bfca-7290-5e92-9d40-7f8f23485812 with scrape type 2
2026-03-29 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6216bfca-7290-5e92-9d40-7f8f23485812, identifier: MU53685
2026-03-29 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-29 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-29 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685 to the API
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:28:04Z',
 'fuel_type': 'petrol',
 'id': '6216bfca-7290-5e92-9d40-7f8f23485812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU53685',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 246019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'BMW 3er 320i EfficientDynamics Edition',
 'transmission': 'automatic',
 'trim': 'EfficientDynamics Edition',
 'year': 2014}
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-29 19:01:00 [auto1.nl] INFO: Saving data for MU53685: {'auction_closing_time': 1774884484.0, 'created_time': 1774551631.379615, 'last_price_update_time': 1774810860.426833}
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MU53685') HTTP/1.1" 204 0
2026-03-29 19:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-29 19:01:00 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-29 19:01:00 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-29 19:01:00 [auto1.nl] INFO: Scrape type for WZ36257: 2
2026-03-29 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-29 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with scrape type 2
2026-03-29 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with scrape type 2
2026-03-29 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28ba592c-7ac3-5729-9be0-10f3ce0989b3, identifier: WZ36257
2026-03-29 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-29 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-29 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257 to the API
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:22:27Z',
 'fuel_type': 'petrol',
 'id': '28ba592c-7ac3-5729-9be0-10f3ce0989b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ36257',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 259254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-22',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-29 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-29 19:01:01 [auto1.nl] INFO: Saving data for WZ36257: {'auction_closing_time': 1774884147.0, 'created_time': 1773133835.683907, 'last_price_update_time': 1774810861.011731}
2026-03-29 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ36257') HTTP/1.1" 204 0
2026-03-29 19:01:01 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-29 19:01:01 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-29 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-29 19:01:01 [auto1.nl] INFO: Scrape type for MT73533: 2
2026-03-29 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-29 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2256f2db-0947-57ef-94a0-278089f7b68f with scrape type 2
2026-03-29 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2256f2db-0947-57ef-94a0-278089f7b68f with scrape type 2
2026-03-29 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2256f2db-0947-57ef-94a0-278089f7b68f, identifier: MT73533
2026-03-29 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-29 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-29 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533 to the API
2026-03-29 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:14Z',
 'fuel_type': 'diesel',
 'id': '2256f2db-0947-57ef-94a0-278089f7b68f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT73533',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 113573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-11',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2010}
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-29 19:01:02 [auto1.nl] INFO: Saving data for MT73533: {'auction_closing_time': 1774885334.0, 'created_time': 1773923303.404222, 'last_price_update_time': 1774810862.252207}
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MT73533') HTTP/1.1" 204 0
2026-03-29 19:01:02 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-29 19:01:02 [auto1.nl] INFO: Scrape type for KD04773: 2
2026-03-29 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-29 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with scrape type 2
2026-03-29 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with scrape type 2
2026-03-29 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8cc2d4fd-7837-5363-a9a9-59e20aecd285, identifier: KD04773
2026-03-29 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-29 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-29 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773 to the API
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:22:09Z',
 'fuel_type': 'petrol',
 'id': '8cc2d4fd-7837-5363-a9a9-59e20aecd285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD04773',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 56902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Cosmo Pack',
 'transmission': 'manual',
 'trim': 'Cosmo Pack',
 'year': 2016}
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-29 19:01:02 [auto1.nl] INFO: Saving data for KD04773: {'auction_closing_time': 1774884129.0, 'created_time': 1774526486.835577, 'last_price_update_time': 1774810862.656544}
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KD04773') HTTP/1.1" 204 0
2026-03-29 19:01:02 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-29 19:01:02 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-29 19:01:02 [auto1.nl] INFO: Scrape type for UF74705: 2
2026-03-29 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0642662a-c840-5af8-97ad-31bedfba5583 with identifier: UF74705
2026-03-29 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0642662a-c840-5af8-97ad-31bedfba5583 with scrape type 2
2026-03-29 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0642662a-c840-5af8-97ad-31bedfba5583 with scrape type 2
2026-03-29 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0642662a-c840-5af8-97ad-31bedfba5583, identifier: UF74705
2026-03-29 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0642662a-c840-5af8-97ad-31bedfba5583 with identifier: UF74705
2026-03-29 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0642662a-c840-5af8-97ad-31bedfba5583 with identifier: UF74705
2026-03-29 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0642662a-c840-5af8-97ad-31bedfba5583 with identifier: UF74705 to the API
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:08:42Z',
 'fuel_type': 'petrol',
 'id': '0642662a-c840-5af8-97ad-31bedfba5583',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF74705',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 162984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-09',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-29 19:01:03 [auto1.nl] INFO: Saving data for UF74705: {'auction_closing_time': 1774883322.0, 'created_time': 1773343430.616885, 'last_price_update_time': 1774810863.05591}
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF74705') HTTP/1.1" 204 0
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-29 19:01:03 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-29 19:01:03 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-29 19:01:03 [auto1.nl] INFO: Scrape type for WC55998: 2
2026-03-29 19:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-29 19:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with scrape type 2
2026-03-29 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with scrape type 2
2026-03-29 19:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b, identifier: WC55998
2026-03-29 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-29 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-29 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998 to the API
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-30T15:40:12Z',
 'fuel_type': 'petrol',
 'id': '9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC55998',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 257159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-10',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-29 19:01:03 [auto1.nl] INFO: Saving data for WC55998: {'auction_closing_time': 1774885212.0, 'created_time': 1774526460.881914, 'last_price_update_time': 1774810863.580978}
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC55998') HTTP/1.1" 204 0
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-29 19:01:03 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-29 19:01:03 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-29 19:01:03 [auto1.nl] INFO: Scrape type for BC03068: 2
2026-03-29 19:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-29 19:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4657347b-0760-5e83-b9da-2506de5a3f41 with scrape type 2
2026-03-29 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4657347b-0760-5e83-b9da-2506de5a3f41 with scrape type 2
2026-03-29 19:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4657347b-0760-5e83-b9da-2506de5a3f41, identifier: BC03068
2026-03-29 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-29 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-29 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068 to the API
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-30T15:28:32Z',
 'fuel_type': 'petrol',
 'id': '4657347b-0760-5e83-b9da-2506de5a3f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC03068',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 120866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Si4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2018}
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-29 19:01:04 [auto1.nl] INFO: Saving data for BC03068: {'auction_closing_time': 1774884512.0, 'created_time': 1773342622.085241, 'last_price_update_time': 1774810864.041385}
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC03068') HTTP/1.1" 204 0
2026-03-29 19:01:04 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-29 19:01:04 [auto1.nl] INFO: Scrape type for VT73125: 2
2026-03-29 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-29 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a125890-abcc-5834-b7b0-59af188eb17e with scrape type 2
2026-03-29 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a125890-abcc-5834-b7b0-59af188eb17e with scrape type 2
2026-03-29 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0a125890-abcc-5834-b7b0-59af188eb17e, identifier: VT73125
2026-03-29 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-29 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-29 19:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125 to the API
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:11:27Z',
 'fuel_type': 'petrol',
 'id': '0a125890-abcc-5834-b7b0-59af188eb17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT73125',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 263692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-13',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2010}
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-29 19:01:04 [auto1.nl] INFO: Saving data for VT73125: {'auction_closing_time': 1774883487.0, 'created_time': 1774612927.420134, 'last_price_update_time': 1774810864.436694}
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VT73125') HTTP/1.1" 204 0
2026-03-29 19:01:04 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-29 19:01:04 [auto1.nl] INFO: Scrape type for LF56220: 2
2026-03-29 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-29 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e027e053-3396-563b-b3e2-a882989d6bc4 with scrape type 2
2026-03-29 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e027e053-3396-563b-b3e2-a882989d6bc4 with scrape type 2
2026-03-29 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e027e053-3396-563b-b3e2-a882989d6bc4, identifier: LF56220
2026-03-29 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-29 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-29 19:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220 to the API
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:05:51Z',
 'fuel_type': 'hybrid',
 'id': 'e027e053-3396-563b-b3e2-a882989d6bc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF56220',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 218059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-29 19:01:04 [auto1.nl] INFO: Saving data for LF56220: {'auction_closing_time': 1774883151.0, 'created_time': 1774526504.617716, 'last_price_update_time': 1774810864.839253}
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF56220') HTTP/1.1" 204 0
2026-03-29 19:01:04 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-29 19:01:04 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-29 19:01:04 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-29 19:01:04 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-29 19:01:04 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-29 19:01:05 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-29 19:01:05 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-29 19:01:05 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-29 19:01:05 [auto1.nl] INFO: Scrape type for AE74076: 2
2026-03-29 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-29 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab50ad30-551e-593f-932a-277391e9665f with scrape type 2
2026-03-29 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab50ad30-551e-593f-932a-277391e9665f with scrape type 2
2026-03-29 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ab50ad30-551e-593f-932a-277391e9665f, identifier: AE74076
2026-03-29 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-29 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-29 19:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076 to the API
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:42:03Z',
 'fuel_type': 'diesel',
 'id': 'ab50ad30-551e-593f-932a-277391e9665f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE74076',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 205570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-20',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-29 19:01:05 [auto1.nl] INFO: Saving data for AE74076: {'auction_closing_time': 1774885323.0, 'created_time': 1773408608.229345, 'last_price_update_time': 1774810865.413418}
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AE74076') HTTP/1.1" 204 0
2026-03-29 19:01:05 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-29 19:01:05 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-29 19:01:05 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 758 | hits on page: 40
2026-03-29 19:01:05 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-29 19:01:05 [auto1.nl] INFO: Scrape type for XJ71773: 2
2026-03-29 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-29 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587b4062-1786-5f79-aafa-869288bf6b45 with scrape type 2
2026-03-29 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587b4062-1786-5f79-aafa-869288bf6b45 with scrape type 2
2026-03-29 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 587b4062-1786-5f79-aafa-869288bf6b45, identifier: XJ71773
2026-03-29 19:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-29 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-29 19:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773 to the API
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:35:23Z',
 'fuel_type': 'petrol',
 'id': '587b4062-1786-5f79-aafa-869288bf6b45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ71773',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 87103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'BMW 4er 420i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-29 19:01:05 [auto1.nl] INFO: Saving data for XJ71773: {'auction_closing_time': 1774884923.0, 'created_time': 1774267370.469334, 'last_price_update_time': 1774810865.914355}
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ71773') HTTP/1.1" 204 0
2026-03-29 19:01:05 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-29 19:01:05 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-29 19:01:05 [auto1.nl] INFO: Scrape type for LF75031: 2
2026-03-29 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-29 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75e2fd9-74f2-5434-b24d-766a89eebb30 with scrape type 2
2026-03-29 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d75e2fd9-74f2-5434-b24d-766a89eebb30 with scrape type 2
2026-03-29 19:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d75e2fd9-74f2-5434-b24d-766a89eebb30, identifier: LF75031
2026-03-29 19:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-29 19:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-29 19:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031 to the API
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:00:11Z',
 'fuel_type': 'petrol',
 'id': 'd75e2fd9-74f2-5434-b24d-766a89eebb30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF75031',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 144832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-24',
 'seller_name': None,
 'title': 'BMW 3er 320i GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-29 19:01:06 [auto1.nl] INFO: Saving data for LF75031: {'auction_closing_time': 1774882811.0, 'created_time': 1774638038.873056, 'last_price_update_time': 1774810866.344131}
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF75031') HTTP/1.1" 204 0
2026-03-29 19:01:06 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-29 19:01:06 [auto1.nl] INFO: Scrape type for PP29341: 2
2026-03-29 19:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-29 19:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with scrape type 2
2026-03-29 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with scrape type 2
2026-03-29 19:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e63cf1c0-3b16-5c7a-a8b5-88546cd74822, identifier: PP29341
2026-03-29 19:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-29 19:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-29 19:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341 to the API
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:44Z',
 'fuel_type': 'petrol',
 'id': 'e63cf1c0-3b16-5c7a-a8b5-88546cd74822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP29341',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 182562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-23',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2005}
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-29 19:01:06 [auto1.nl] INFO: Saving data for PP29341: {'auction_closing_time': 1774884584.0, 'created_time': 1774094520.819926, 'last_price_update_time': 1774810866.778244}
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PP29341') HTTP/1.1" 204 0
2026-03-29 19:01:06 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-29 19:01:06 [auto1.nl] INFO: Scrape type for ZY76952: 2
2026-03-29 19:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-29 19:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with scrape type 2
2026-03-29 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with scrape type 2
2026-03-29 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5fe40737-41f2-5ed0-b906-886d15eb0cb2, identifier: ZY76952
2026-03-29 19:01:07 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at 15 pages/min), scraped 69 items (at 69 items/min)
2026-03-29 19:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-29 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-29 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952 to the API
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:56:38Z',
 'fuel_type': 'petrol',
 'id': '5fe40737-41f2-5ed0-b906-886d15eb0cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY76952',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 143558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-29 19:01:07 [auto1.nl] INFO: Saving data for ZY76952: {'auction_closing_time': 1774886198.0, 'created_time': 1773302531.720045, 'last_price_update_time': 1774810867.353476}
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZY76952') HTTP/1.1" 204 0
2026-03-29 19:01:07 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-29 19:01:07 [auto1.nl] INFO: Scrape type for FC33520: 2
2026-03-29 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-29 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f2a6450-f659-5f76-bd5f-f8182c999bcc with scrape type 2
2026-03-29 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f2a6450-f659-5f76-bd5f-f8182c999bcc with scrape type 2
2026-03-29 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7f2a6450-f659-5f76-bd5f-f8182c999bcc, identifier: FC33520
2026-03-29 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-29 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-29 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520 to the API
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'petrol',
 'id': '7f2a6450-f659-5f76-bd5f-f8182c999bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC33520',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 220347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-29 19:01:07 [auto1.nl] INFO: Saving data for FC33520: {'auction_closing_time': 1774884913.0, 'created_time': 1774526496.69668, 'last_price_update_time': 1774810867.741776}
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FC33520') HTTP/1.1" 204 0
2026-03-29 19:01:07 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-29 19:01:07 [auto1.nl] INFO: Scrape type for NF23683: 2
2026-03-29 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-29 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with scrape type 2
2026-03-29 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with scrape type 2
2026-03-29 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab, identifier: NF23683
2026-03-29 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-29 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-29 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683 to the API
2026-03-29 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:57Z',
 'fuel_type': 'petrol',
 'id': '5bc5c40f-a752-5a49-9269-c9cd8c7a0bab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF23683',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 71757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-10-07',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 1997}
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-29 19:01:08 [auto1.nl] INFO: Saving data for NF23683: {'auction_closing_time': 1774883337.0, 'created_time': 1774612913.286393, 'last_price_update_time': 1774810868.181947}
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NF23683') HTTP/1.1" 204 0
2026-03-29 19:01:08 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-29 19:01:08 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-29 19:01:08 [auto1.nl] INFO: Scrape type for CR43638: 2
2026-03-29 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-29 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa788e2c-e5db-583a-9086-06980bff4626 with scrape type 2
2026-03-29 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa788e2c-e5db-583a-9086-06980bff4626 with scrape type 2
2026-03-29 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa788e2c-e5db-583a-9086-06980bff4626, identifier: CR43638
2026-03-29 19:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-29 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-29 19:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638 to the API
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:45:25Z',
 'fuel_type': 'petrol',
 'id': 'fa788e2c-e5db-583a-9086-06980bff4626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR43638',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 343820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-30',
 'seller_name': None,
 'title': 'Volvo XC70 2.5 T AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2004}
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-29 19:01:08 [auto1.nl] INFO: Saving data for CR43638: {'auction_closing_time': 1774885525.0, 'created_time': 1773688140.77592, 'last_price_update_time': 1774810868.641572}
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR43638') HTTP/1.1" 204 0
2026-03-29 19:01:08 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-29 19:01:08 [auto1.nl] INFO: Scrape type for LH66044: 2
2026-03-29 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-29 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 403fad5d-d905-5b73-babd-73a4fc03a4b2 with scrape type 2
2026-03-29 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 403fad5d-d905-5b73-babd-73a4fc03a4b2 with scrape type 2
2026-03-29 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 403fad5d-d905-5b73-babd-73a4fc03a4b2, identifier: LH66044
2026-03-29 19:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-29 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-29 19:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044 to the API
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:22Z',
 'fuel_type': 'diesel',
 'id': '403fad5d-d905-5b73-babd-73a4fc03a4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH66044',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 280431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-29',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D3 Linje Classic',
 'transmission': 'manual',
 'trim': 'Linje Classic',
 'year': 2015}
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-29 19:01:09 [auto1.nl] INFO: Saving data for LH66044: {'auction_closing_time': 1774884322.0, 'created_time': 1773514831.760093, 'last_price_update_time': 1774810869.097706}
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH66044') HTTP/1.1" 204 0
2026-03-29 19:01:09 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-29 19:01:09 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-29 19:01:09 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-29 19:01:09 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-29 19:01:09 [auto1.nl] INFO: Scrape type for XJ87481: 2
2026-03-29 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-29 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028a42f1-9ffa-50d6-a30b-fed070358151 with scrape type 2
2026-03-29 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 028a42f1-9ffa-50d6-a30b-fed070358151 with scrape type 2
2026-03-29 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 028a42f1-9ffa-50d6-a30b-fed070358151, identifier: XJ87481
2026-03-29 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-29 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-29 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481 to the API
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:40:21Z',
 'fuel_type': 'petrol',
 'id': '028a42f1-9ffa-50d6-a30b-fed070358151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ87481',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 86841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2020}
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-29 19:01:09 [auto1.nl] INFO: Saving data for XJ87481: {'auction_closing_time': 1774885221.0, 'created_time': 1773132399.825246, 'last_price_update_time': 1774810869.555466}
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ87481') HTTP/1.1" 204 0
2026-03-29 19:01:09 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-29 19:01:09 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-29 19:01:09 [auto1.nl] INFO: Scrape type for NH69771: 2
2026-03-29 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-29 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b945ca5-8729-5969-8084-dd3813847f20 with scrape type 2
2026-03-29 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b945ca5-8729-5969-8084-dd3813847f20 with scrape type 2
2026-03-29 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b945ca5-8729-5969-8084-dd3813847f20, identifier: NH69771
2026-03-29 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-29 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-29 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771 to the API
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:48:11Z',
 'fuel_type': 'petrol',
 'id': '5b945ca5-8729-5969-8084-dd3813847f20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH69771',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-29 19:01:09 [auto1.nl] INFO: Saving data for NH69771: {'auction_closing_time': 1774885691.0, 'created_time': 1774612904.604052, 'last_price_update_time': 1774810869.991108}
2026-03-29 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NH69771') HTTP/1.1" 204 0
2026-03-29 19:01:10 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-29 19:01:10 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-29 19:01:10 [auto1.nl] INFO: Scrape type for AM42063: 2
2026-03-29 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with identifier: AM42063
2026-03-29 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with scrape type 2
2026-03-29 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with scrape type 2
2026-03-29 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f, identifier: AM42063
2026-03-29 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with identifier: AM42063
2026-03-29 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with identifier: AM42063
2026-03-29 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f with identifier: AM42063 to the API
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:51Z',
 'fuel_type': 'petrol',
 'id': 'a44fd0f8-2bfe-5f9b-8ea6-85057d88ae6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM42063',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 124679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-20',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-29 19:01:10 [auto1.nl] INFO: Saving data for AM42063: {'auction_closing_time': 1774883031.0, 'created_time': 1774724459.048436, 'last_price_update_time': 1774810870.492411}
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AM42063') HTTP/1.1" 204 0
2026-03-29 19:01:10 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-29 19:01:10 [auto1.nl] INFO: Scrape type for SB99593: 2
2026-03-29 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-29 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba758880-b6e0-5a79-a87e-f00119eb694c with scrape type 2
2026-03-29 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba758880-b6e0-5a79-a87e-f00119eb694c with scrape type 2
2026-03-29 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ba758880-b6e0-5a79-a87e-f00119eb694c, identifier: SB99593
2026-03-29 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-29 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-29 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593 to the API
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:08:26Z',
 'fuel_type': 'petrol',
 'id': 'ba758880-b6e0-5a79-a87e-f00119eb694c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB99593',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 237606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-11',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-29 19:01:10 [auto1.nl] INFO: Saving data for SB99593: {'auction_closing_time': 1774883306.0, 'created_time': 1774612851.256512, 'last_price_update_time': 1774810870.964396}
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SB99593') HTTP/1.1" 204 0
2026-03-29 19:01:10 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-29 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Scrape type for GK86118: 2
2026-03-29 19:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-29 19:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23e57ec-1928-59dc-9d38-b84d16cd6859 with scrape type 2
2026-03-29 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23e57ec-1928-59dc-9d38-b84d16cd6859 with scrape type 2
2026-03-29 19:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f23e57ec-1928-59dc-9d38-b84d16cd6859, identifier: GK86118
2026-03-29 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-29 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-29 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118 to the API
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:34:01Z',
 'fuel_type': 'petrol',
 'id': 'f23e57ec-1928-59dc-9d38-b84d16cd6859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK86118',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 62977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Saving data for GK86118: {'auction_closing_time': 1774884841.0, 'created_time': 1774612909.369529, 'last_price_update_time': 1774810871.570753}
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GK86118') HTTP/1.1" 204 0
2026-03-29 19:01:11 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 758 | hits on page: 40
2026-03-29 19:01:11 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-29 19:01:11 [auto1.nl] INFO: Scrape type for PD24155: 2
2026-03-29 19:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-29 19:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with scrape type 2
2026-03-29 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with scrape type 2
2026-03-29 19:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e, identifier: PD24155
2026-03-29 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-29 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-29 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155 to the API
2026-03-29 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:00:49Z',
 'fuel_type': 'petrol',
 'id': 'a85fc4b1-7efd-526b-9ac5-a5cb6113a84e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD24155',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Cuore',
 'odometer': 274592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-08',
 'seller_name': None,
 'title': 'Daihatsu Cuore 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Saving data for PD24155: {'auction_closing_time': 1774882849.0, 'created_time': 1774612917.829419, 'last_price_update_time': 1774810872.111677}
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PD24155') HTTP/1.1" 204 0
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Scrape type for CC90793: 2
2026-03-29 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-29 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c95ce620-8b77-59ba-8269-2f4c78b76f63 with scrape type 2
2026-03-29 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c95ce620-8b77-59ba-8269-2f4c78b76f63 with scrape type 2
2026-03-29 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c95ce620-8b77-59ba-8269-2f4c78b76f63, identifier: CC90793
2026-03-29 19:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-29 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-29 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-29 19:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793 to the API
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:47:03Z',
 'fuel_type': 'petrol',
 'id': 'c95ce620-8b77-59ba-8269-2f4c78b76f63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC90793',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 204594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-02',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Saving data for CC90793: {'auction_closing_time': 1774885623.0, 'created_time': 1774119698.454132, 'last_price_update_time': 1774810872.679668}
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CC90793') HTTP/1.1" 204 0
2026-03-29 19:01:12 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-29 19:01:12 [auto1.nl] INFO: Scrape type for LG18300: 2
2026-03-29 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-29 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916443fa-fa92-5806-9155-9fc77689165c with scrape type 2
2026-03-29 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 916443fa-fa92-5806-9155-9fc77689165c with scrape type 2
2026-03-29 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 916443fa-fa92-5806-9155-9fc77689165c, identifier: LG18300
2026-03-29 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-29 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-29 19:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300 to the API
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:55:39Z',
 'fuel_type': 'petrol',
 'id': '916443fa-fa92-5806-9155-9fc77689165c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG18300',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 212035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-29 19:01:13 [auto1.nl] INFO: Saving data for LG18300: {'auction_closing_time': 1774886139.0, 'created_time': 1773688236.711237, 'last_price_update_time': 1774810873.272097}
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG18300') HTTP/1.1" 204 0
2026-03-29 19:01:13 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-29 19:01:13 [auto1.nl] INFO: Scrape type for RF14080: 2
2026-03-29 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-29 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f58db08d-2df7-51eb-b014-a8599e085b07 with scrape type 2
2026-03-29 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f58db08d-2df7-51eb-b014-a8599e085b07 with scrape type 2
2026-03-29 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f58db08d-2df7-51eb-b014-a8599e085b07, identifier: RF14080
2026-03-29 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-29 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-29 19:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080 to the API
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:27Z',
 'fuel_type': 'petrol',
 'id': 'f58db08d-2df7-51eb-b014-a8599e085b07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF14080',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 427233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-10',
 'seller_name': None,
 'title': 'Volvo V50 2.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-29 19:01:13 [auto1.nl] INFO: Saving data for RF14080: {'auction_closing_time': 1774884867.0, 'created_time': 1774526469.927141, 'last_price_update_time': 1774810873.672774}
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF14080') HTTP/1.1" 204 0
2026-03-29 19:01:13 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-29 19:01:13 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-29 19:01:13 [auto1.nl] INFO: Scrape type for AG89497: 2
2026-03-29 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-29 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with scrape type 2
2026-03-29 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with scrape type 2
2026-03-29 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7a7ec237-2a90-569e-8b1b-718a7386d8d4, identifier: AG89497
2026-03-29 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-29 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-29 19:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497 to the API
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:01:10Z',
 'fuel_type': 'diesel',
 'id': '7a7ec237-2a90-569e-8b1b-718a7386d8d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG89497',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 342341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-23',
 'seller_name': None,
 'title': 'BMW 3er 330d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-29 19:01:14 [auto1.nl] INFO: Saving data for AG89497: {'auction_closing_time': 1774882870.0, 'created_time': 1774612906.109168, 'last_price_update_time': 1774810874.092646}
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AG89497') HTTP/1.1" 204 0
2026-03-29 19:01:14 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-29 19:01:14 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-29 19:01:14 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-29 19:01:14 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-29 19:01:14 [auto1.nl] INFO: Scrape type for KP98004: 2
2026-03-29 19:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-29 19:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32785756-aa7c-5091-908d-c11fe7e13fe3 with scrape type 2
2026-03-29 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32785756-aa7c-5091-908d-c11fe7e13fe3 with scrape type 2
2026-03-29 19:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32785756-aa7c-5091-908d-c11fe7e13fe3, identifier: KP98004
2026-03-29 19:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-29 19:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-29 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004 to the API
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:05:07Z',
 'fuel_type': 'hybrid',
 'id': '32785756-aa7c-5091-908d-c11fe7e13fe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP98004',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 72861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-29 19:01:14 [auto1.nl] INFO: Saving data for KP98004: {'auction_closing_time': 1774883107.0, 'created_time': 1774526471.831529, 'last_price_update_time': 1774810874.488703}
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP98004') HTTP/1.1" 204 0
2026-03-29 19:01:14 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-29 19:01:14 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-29 19:01:14 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-29 19:01:14 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-29 19:01:14 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-29 19:01:14 [auto1.nl] INFO: Scrape type for ME73088: 2
2026-03-29 19:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-29 19:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with scrape type 2
2026-03-29 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with scrape type 2
2026-03-29 19:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 345d9a56-61ba-57e4-b1c5-17f279b7ada9, identifier: ME73088
2026-03-29 19:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-29 19:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-29 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088 to the API
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:07:38Z',
 'fuel_type': 'diesel',
 'id': '345d9a56-61ba-57e4-b1c5-17f279b7ada9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME73088',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 175572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-11',
 'seller_name': None,
 'title': 'Citroen C3 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-29 19:01:14 [auto1.nl] INFO: Saving data for ME73088: {'auction_closing_time': 1774883258.0, 'created_time': 1774612895.277212, 'last_price_update_time': 1774810874.9471}
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME73088') HTTP/1.1" 204 0
2026-03-29 19:01:15 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-29 19:01:15 [auto1.nl] INFO: Scrape type for BD38212: 2
2026-03-29 19:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-29 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f626f2aa-bd02-5806-afd1-4a4942fb0066 with scrape type 2
2026-03-29 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f626f2aa-bd02-5806-afd1-4a4942fb0066 with scrape type 2
2026-03-29 19:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f626f2aa-bd02-5806-afd1-4a4942fb0066, identifier: BD38212
2026-03-29 19:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-29 19:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-29 19:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212 to the API
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:18:49Z',
 'fuel_type': 'petrol',
 'id': 'f626f2aa-bd02-5806-afd1-4a4942fb0066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD38212',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 118750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-29 19:01:15 [auto1.nl] INFO: Saving data for BD38212: {'auction_closing_time': 1774883929.0, 'created_time': 1773133233.390175, 'last_price_update_time': 1774810875.493839}
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD38212') HTTP/1.1" 204 0
2026-03-29 19:01:15 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-29 19:01:15 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-29 19:01:15 [auto1.nl] INFO: Scrape type for JA96094: 2
2026-03-29 19:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-29 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f998d16-defa-5ffb-9e97-14c2372f574d with scrape type 2
2026-03-29 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f998d16-defa-5ffb-9e97-14c2372f574d with scrape type 2
2026-03-29 19:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9f998d16-defa-5ffb-9e97-14c2372f574d, identifier: JA96094
2026-03-29 19:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-29 19:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-29 19:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094 to the API
2026-03-29 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:55:15Z',
 'fuel_type': 'petrol',
 'id': '9f998d16-defa-5ffb-9e97-14c2372f574d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA96094',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 263681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-04',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-29 19:01:16 [auto1.nl] INFO: Saving data for JA96094: {'auction_closing_time': 1774886115.0, 'created_time': 1774094522.883026, 'last_price_update_time': 1774810876.849383}
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JA96094') HTTP/1.1" 204 0
2026-03-29 19:01:16 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-29 19:01:16 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-29 19:01:16 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-29 19:01:16 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-29 19:01:16 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-29 19:01:16 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-29 19:01:16 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-29 19:01:16 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-29 19:01:16 [auto1.nl] INFO: Scrape type for UY50656: 2
2026-03-29 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-29 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with scrape type 2
2026-03-29 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with scrape type 2
2026-03-29 19:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d4cf50c9-964f-59d3-8fb8-81f2be8f9532, identifier: UY50656
2026-03-29 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-29 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-29 19:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656 to the API
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:57:11Z',
 'fuel_type': 'petrol',
 'id': 'd4cf50c9-964f-59d3-8fb8-81f2be8f9532',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY50656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 396705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-29 19:01:17 [auto1.nl] INFO: Saving data for UY50656: {'auction_closing_time': 1774886231.0, 'created_time': 1774612848.256076, 'last_price_update_time': 1774810877.323589}
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY50656') HTTP/1.1" 204 0
2026-03-29 19:01:17 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-29 19:01:17 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-29 19:01:17 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-29 19:01:17 [auto1.nl] INFO: Scrape type for SA65575: 2
2026-03-29 19:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-29 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5637948d-a2e9-5b39-afb0-c2999649df09 with scrape type 2
2026-03-29 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5637948d-a2e9-5b39-afb0-c2999649df09 with scrape type 2
2026-03-29 19:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5637948d-a2e9-5b39-afb0-c2999649df09, identifier: SA65575
2026-03-29 19:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-29 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-29 19:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575 to the API
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:50:42Z',
 'fuel_type': 'hybrid',
 'id': '5637948d-a2e9-5b39-afb0-c2999649df09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA65575',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 145796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-20',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-29 19:01:17 [auto1.nl] INFO: Saving data for SA65575: {'auction_closing_time': 1774885842.0, 'created_time': 1774612856.649204, 'last_price_update_time': 1774810877.814947}
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA65575') HTTP/1.1" 204 0
2026-03-29 19:01:17 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-29 19:01:17 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-29 19:01:17 [auto1.nl] INFO: Scrape type for LS97590: 2
2026-03-29 19:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910f7408-963a-5ab7-a56a-45152d4c3d36 with identifier: LS97590
2026-03-29 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910f7408-963a-5ab7-a56a-45152d4c3d36 with scrape type 2
2026-03-29 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 910f7408-963a-5ab7-a56a-45152d4c3d36 with scrape type 2
2026-03-29 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 910f7408-963a-5ab7-a56a-45152d4c3d36, identifier: LS97590
2026-03-29 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 910f7408-963a-5ab7-a56a-45152d4c3d36 with identifier: LS97590
2026-03-29 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 910f7408-963a-5ab7-a56a-45152d4c3d36 with identifier: LS97590
2026-03-29 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 910f7408-963a-5ab7-a56a-45152d4c3d36 with identifier: LS97590 to the API
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 109,
 'expiration_date': '2026-03-30T15:26:50Z',
 'fuel_type': 'petrol',
 'id': '910f7408-963a-5ab7-a56a-45152d4c3d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS97590',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 81114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-29 19:01:18 [auto1.nl] INFO: Saving data for LS97590: {'auction_closing_time': 1774884410.0, 'created_time': 1774033368.996738, 'last_price_update_time': 1774810878.328283}
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LS97590') HTTP/1.1" 204 0
2026-03-29 19:01:18 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 758 | hits on page: 40
2026-03-29 19:01:18 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-29 19:01:18 [auto1.nl] INFO: Scrape type for HX62169: 2
2026-03-29 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-29 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with scrape type 2
2026-03-29 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with scrape type 2
2026-03-29 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76, identifier: HX62169
2026-03-29 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-29 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-29 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169 to the API
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:54:48Z',
 'fuel_type': 'petrol',
 'id': 'fc33c8e7-9d6c-57ac-b25b-14f09f86fa76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX62169',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 122332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-25',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2016}
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-29 19:01:18 [auto1.nl] INFO: Saving data for HX62169: {'auction_closing_time': 1774886088.0, 'created_time': 1774612924.529413, 'last_price_update_time': 1774810878.704762}
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX62169') HTTP/1.1" 204 0
2026-03-29 19:01:18 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-29 19:01:18 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-29 19:01:18 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-29 19:01:18 [auto1.nl] INFO: Scrape type for MP21910: 2
2026-03-29 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-29 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e503149d-281b-59b6-950e-a3d8945ab770 with scrape type 2
2026-03-29 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e503149d-281b-59b6-950e-a3d8945ab770 with scrape type 2
2026-03-29 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e503149d-281b-59b6-950e-a3d8945ab770, identifier: MP21910
2026-03-29 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:18 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-29 19:01:18 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-29 19:01:18 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-29 19:01:18 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-29 19:01:18 [auto1.nl] INFO: Scrape type for RY51498: 2
2026-03-29 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-29 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01169767-6f64-578c-bae4-993e41c16c16 with scrape type 2
2026-03-29 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01169767-6f64-578c-bae4-993e41c16c16 with scrape type 2
2026-03-29 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 01169767-6f64-578c-bae4-993e41c16c16, identifier: RY51498
2026-03-29 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-29 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-29 19:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910 to the API
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:10:04Z',
 'fuel_type': 'petrol',
 'id': 'e503149d-281b-59b6-950e-a3d8945ab770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP21910',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 134300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2018}
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-29 19:01:19 [auto1.nl] INFO: Saving data for MP21910: {'auction_closing_time': 1774883404.0, 'created_time': 1774526483.338157, 'last_price_update_time': 1774810879.249977}
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP21910') HTTP/1.1" 204 0
2026-03-29 19:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-29 19:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-29 19:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498 to the API
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:23Z',
 'fuel_type': 'petrol',
 'id': '01169767-6f64-578c-bae4-993e41c16c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY51498',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 264209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 FSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2004}
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-29 19:01:19 [auto1.nl] INFO: Saving data for RY51498: {'auction_closing_time': 1774883063.0, 'created_time': 1774033466.589215, 'last_price_update_time': 1774810879.541324}
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY51498') HTTP/1.1" 204 0
2026-03-29 19:01:19 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-29 19:01:19 [auto1.nl] INFO: Scrape type for KP34214: 2
2026-03-29 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42c83913-facc-5c46-95fe-7cb135f40e85 with identifier: KP34214
2026-03-29 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42c83913-facc-5c46-95fe-7cb135f40e85 with scrape type 2
2026-03-29 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42c83913-facc-5c46-95fe-7cb135f40e85 with scrape type 2
2026-03-29 19:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 42c83913-facc-5c46-95fe-7cb135f40e85, identifier: KP34214
2026-03-29 19:01:19 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-29 19:01:19 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-29 19:01:19 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-29 19:01:19 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-29 19:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 42c83913-facc-5c46-95fe-7cb135f40e85 with identifier: KP34214
2026-03-29 19:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 42c83913-facc-5c46-95fe-7cb135f40e85 with identifier: KP34214
2026-03-29 19:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 42c83913-facc-5c46-95fe-7cb135f40e85 with identifier: KP34214 to the API
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:03:43Z',
 'fuel_type': 'petrol',
 'id': '42c83913-facc-5c46-95fe-7cb135f40e85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP34214',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 224025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-25',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-29 19:01:19 [auto1.nl] INFO: Saving data for KP34214: {'auction_closing_time': 1774883023.0, 'created_time': 1774724468.337984, 'last_price_update_time': 1774810879.965779}
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP34214') HTTP/1.1" 204 0
2026-03-29 19:01:20 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-29 19:01:20 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-29 19:01:20 [auto1.nl] INFO: Scrape type for SL12489: 2
2026-03-29 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-29 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 089b05a9-5f33-5c13-ad69-689086c457da with scrape type 2
2026-03-29 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 089b05a9-5f33-5c13-ad69-689086c457da with scrape type 2
2026-03-29 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 089b05a9-5f33-5c13-ad69-689086c457da, identifier: SL12489
2026-03-29 19:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-29 19:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-29 19:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489 to the API
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:48:59Z',
 'fuel_type': 'hybrid',
 'id': '089b05a9-5f33-5c13-ad69-689086c457da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL12489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 111869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-29 19:01:20 [auto1.nl] INFO: Saving data for SL12489: {'auction_closing_time': 1774885739.0, 'created_time': 1773688329.132838, 'last_price_update_time': 1774810880.482817}
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SL12489') HTTP/1.1" 204 0
2026-03-29 19:01:20 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-29 19:01:20 [auto1.nl] INFO: Scrape type for PB89826: 2
2026-03-29 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-29 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0924e34c-8623-57d1-a916-c0a2513425a4 with scrape type 2
2026-03-29 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0924e34c-8623-57d1-a916-c0a2513425a4 with scrape type 2
2026-03-29 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0924e34c-8623-57d1-a916-c0a2513425a4, identifier: PB89826
2026-03-29 19:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-29 19:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-29 19:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826 to the API
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-30T15:26:53Z',
 'fuel_type': 'hybrid',
 'id': '0924e34c-8623-57d1-a916-c0a2513425a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB89826',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 82924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-06',
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2022}
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-29 19:01:20 [auto1.nl] INFO: Saving data for PB89826: {'auction_closing_time': 1774884413.0, 'created_time': 1774353790.407247, 'last_price_update_time': 1774810880.907425}
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PB89826') HTTP/1.1" 204 0
2026-03-29 19:01:20 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-29 19:01:20 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-29 19:01:20 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-29 19:01:20 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-29 19:01:20 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-29 19:01:20 [auto1.nl] INFO: Scrape type for RY20438: 2
2026-03-29 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-29 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa245c6d-5eeb-53ca-8f47-b44339c58044 with scrape type 2
2026-03-29 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa245c6d-5eeb-53ca-8f47-b44339c58044 with scrape type 2
2026-03-29 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa245c6d-5eeb-53ca-8f47-b44339c58044, identifier: RY20438
2026-03-29 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-29 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-29 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438 to the API
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:26Z',
 'fuel_type': 'petrol',
 'id': 'fa245c6d-5eeb-53ca-8f47-b44339c58044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY20438',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 67852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-29 19:01:21 [auto1.nl] INFO: Saving data for RY20438: {'auction_closing_time': 1774884266.0, 'created_time': 1774526441.657556, 'last_price_update_time': 1774810881.317275}
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY20438') HTTP/1.1" 204 0
2026-03-29 19:01:21 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-29 19:01:21 [auto1.nl] INFO: Scrape type for JC34887: 2
2026-03-29 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-29 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1d2e80-da32-5823-8172-6c9d1987bf83 with scrape type 2
2026-03-29 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1d2e80-da32-5823-8172-6c9d1987bf83 with scrape type 2
2026-03-29 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bc1d2e80-da32-5823-8172-6c9d1987bf83, identifier: JC34887
2026-03-29 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-29 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-29 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887 to the API
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:46Z',
 'fuel_type': 'petrol',
 'id': 'bc1d2e80-da32-5823-8172-6c9d1987bf83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC34887',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 118986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-29 19:01:21 [auto1.nl] INFO: Saving data for JC34887: {'auction_closing_time': 1774885666.0, 'created_time': 1774526495.360027, 'last_price_update_time': 1774810881.698577}
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC34887') HTTP/1.1" 204 0
2026-03-29 19:01:21 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-29 19:01:21 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-29 19:01:21 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-29 19:01:21 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-29 19:01:21 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-29 19:01:21 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-29 19:01:21 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-29 19:01:21 [auto1.nl] INFO: Scrape type for AA56023: 2
2026-03-29 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-29 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with scrape type 2
2026-03-29 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with scrape type 2
2026-03-29 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0090e5ea-dc74-53b5-bcb9-85c7a357b069, identifier: AA56023
2026-03-29 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-29 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-29 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023 to the API
2026-03-29 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:50:35Z',
 'fuel_type': 'petrol',
 'id': '0090e5ea-dc74-53b5-bcb9-85c7a357b069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA56023',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 137494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-25',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 PureTech Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2015}
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-29 19:01:22 [auto1.nl] INFO: Saving data for AA56023: {'auction_closing_time': 1774885835.0, 'created_time': 1774612929.080075, 'last_price_update_time': 1774810882.150032}
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AA56023') HTTP/1.1" 204 0
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-29 19:01:22 [auto1.nl] INFO: Scrape type for UA44354: 2
2026-03-29 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-29 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6bf74ae-ea26-5e34-8fe8-484868109907 with scrape type 2
2026-03-29 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6bf74ae-ea26-5e34-8fe8-484868109907 with scrape type 2
2026-03-29 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6bf74ae-ea26-5e34-8fe8-484868109907, identifier: UA44354
2026-03-29 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-29 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-29 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354 to the API
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:11:23Z',
 'fuel_type': 'petrol',
 'id': 'd6bf74ae-ea26-5e34-8fe8-484868109907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA44354',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 164078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'BMW X6 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-29 19:01:22 [auto1.nl] INFO: Saving data for UA44354: {'auction_closing_time': 1774883483.0, 'created_time': 1774526475.493805, 'last_price_update_time': 1774810882.655357}
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UA44354') HTTP/1.1" 204 0
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-29 19:01:22 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-29 19:01:22 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-29 19:01:22 [auto1.nl] INFO: Scrape type for KV59291: 2
2026-03-29 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-29 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with scrape type 2
2026-03-29 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with scrape type 2
2026-03-29 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e, identifier: KV59291
2026-03-29 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-29 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-29 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291 to the API
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:02:13Z',
 'fuel_type': 'hybrid',
 'id': '07252a0b-a4b2-5178-94a4-3e50bf65bc9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV59291',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 296665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-17',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D5 Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2015}
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-29 19:01:23 [auto1.nl] INFO: Saving data for KV59291: {'auction_closing_time': 1774882933.0, 'created_time': 1774638057.311481, 'last_price_update_time': 1774810883.107668}
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV59291') HTTP/1.1" 204 0
2026-03-29 19:01:23 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-29 19:01:23 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-29 19:01:23 [auto1.nl] INFO: Scrape type for WZ30415: 2
2026-03-29 19:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-29 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with scrape type 2
2026-03-29 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with scrape type 2
2026-03-29 19:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4, identifier: WZ30415
2026-03-29 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-29 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-29 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415 to the API
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:41:23Z',
 'fuel_type': 'petrol',
 'id': '3d4e06d9-37dc-525f-8727-d33fe0b0eba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ30415',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 295070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-31',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 Turbo OPC',
 'transmission': 'manual',
 'trim': 'OPC',
 'year': 2003}
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-29 19:01:23 [auto1.nl] INFO: Saving data for WZ30415: {'auction_closing_time': 1774885283.0, 'created_time': 1774526487.712862, 'last_price_update_time': 1774810883.495707}
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ30415') HTTP/1.1" 204 0
2026-03-29 19:01:23 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-29 19:01:23 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-29 19:01:23 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-29 19:01:23 [auto1.nl] INFO: Scrape type for CY67010: 2
2026-03-29 19:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-29 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626b999f-1528-580b-b99b-228af78dc2b6 with scrape type 2
2026-03-29 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626b999f-1528-580b-b99b-228af78dc2b6 with scrape type 2
2026-03-29 19:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 626b999f-1528-580b-b99b-228af78dc2b6, identifier: CY67010
2026-03-29 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-29 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-29 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010 to the API
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:22:07Z',
 'fuel_type': 'petrol',
 'id': '626b999f-1528-580b-b99b-228af78dc2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY67010',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 241219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-23',
 'seller_name': None,
 'title': 'Volvo V70 1.6 T4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2011}
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Saving data for CY67010: {'auction_closing_time': 1774884127.0, 'created_time': 1773687672.755652, 'last_price_update_time': 1774810884.034374}
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY67010') HTTP/1.1" 204 0
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Scrape type for PZ30163: 2
2026-03-29 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-29 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with scrape type 2
2026-03-29 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with scrape type 2
2026-03-29 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2, identifier: PZ30163
2026-03-29 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-29 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-29 19:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163 to the API
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:41:15Z',
 'fuel_type': 'petrol',
 'id': '162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ30163',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 168552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-26',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 2.0 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2004}
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Saving data for PZ30163: {'auction_closing_time': 1774885275.0, 'created_time': 1774526476.553527, 'last_price_update_time': 1774810884.547493}
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PZ30163') HTTP/1.1" 204 0
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-29 19:01:24 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Scrape type for TP38124: 2
2026-03-29 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-29 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with scrape type 2
2026-03-29 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with scrape type 2
2026-03-29 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7, identifier: TP38124
2026-03-29 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-29 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-29 19:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124 to the API
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:06:54Z',
 'fuel_type': 'petrol',
 'id': '9700523c-b88a-5e0e-a0b2-d5b74785d7d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP38124',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 180879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2014}
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-29 19:01:24 [auto1.nl] INFO: Saving data for TP38124: {'auction_closing_time': 1774883214.0, 'created_time': 1774526507.553276, 'last_price_update_time': 1774810884.962045}
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP38124') HTTP/1.1" 204 0
2026-03-29 19:01:25 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 758 | hits on page: 40
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-29 19:01:25 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-29 19:01:25 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-29 19:01:25 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-29 19:01:25 [auto1.nl] INFO: Scrape type for CX26987: 2
2026-03-29 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-29 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f461c9-4265-55cb-bcc0-023d3dc18d5d with scrape type 2
2026-03-29 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f461c9-4265-55cb-bcc0-023d3dc18d5d with scrape type 2
2026-03-29 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96f461c9-4265-55cb-bcc0-023d3dc18d5d, identifier: CX26987
2026-03-29 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-29 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-29 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987 to the API
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:48:33Z',
 'fuel_type': 'petrol',
 'id': '96f461c9-4265-55cb-bcc0-023d3dc18d5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX26987',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 61131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-29 19:01:25 [auto1.nl] INFO: Saving data for CX26987: {'auction_closing_time': 1774885713.0, 'created_time': 1774612881.636129, 'last_price_update_time': 1774810885.552988}
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CX26987') HTTP/1.1" 204 0
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-29 19:01:25 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-29 19:01:25 [auto1.nl] INFO: Scrape type for HX39878: 2
2026-03-29 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-29 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with scrape type 2
2026-03-29 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with scrape type 2
2026-03-29 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4, identifier: HX39878
2026-03-29 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-29 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-29 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878 to the API
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:17:17Z',
 'fuel_type': 'diesel',
 'id': '3e56f71a-324e-5b5e-98ba-a45bc9312ca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX39878',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 302684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-29 19:01:25 [auto1.nl] INFO: Saving data for HX39878: {'auction_closing_time': 1774883837.0, 'created_time': 1773301433.958018, 'last_price_update_time': 1774810885.996513}
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX39878') HTTP/1.1" 204 0
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-29 19:01:26 [auto1.nl] INFO: Scrape type for CD92062: 2
2026-03-29 19:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-29 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a32fc544-599c-5d4f-80c1-4427b167bb58 with scrape type 2
2026-03-29 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a32fc544-599c-5d4f-80c1-4427b167bb58 with scrape type 2
2026-03-29 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a32fc544-599c-5d4f-80c1-4427b167bb58, identifier: CD92062
2026-03-29 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-29 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-29 19:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062 to the API
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:17:58Z',
 'fuel_type': 'petrol',
 'id': 'a32fc544-599c-5d4f-80c1-4427b167bb58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD92062',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S40',
 'odometer': 194182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-09',
 'seller_name': None,
 'title': 'Volvo S40 2.4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2004}
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-29 19:01:26 [auto1.nl] INFO: Saving data for CD92062: {'auction_closing_time': 1774883878.0, 'created_time': 1774526490.094607, 'last_price_update_time': 1774810886.389731}
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CD92062') HTTP/1.1" 204 0
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-29 19:01:26 [auto1.nl] INFO: Scrape type for HT40495: 2
2026-03-29 19:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-29 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da3445bc-a86e-5c98-bdcd-d53d95056772 with scrape type 2
2026-03-29 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da3445bc-a86e-5c98-bdcd-d53d95056772 with scrape type 2
2026-03-29 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: da3445bc-a86e-5c98-bdcd-d53d95056772, identifier: HT40495
2026-03-29 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-29 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-29 19:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495 to the API
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:02Z',
 'fuel_type': 'petrol',
 'id': 'da3445bc-a86e-5c98-bdcd-d53d95056772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT40495',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 199743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-29 19:01:26 [auto1.nl] INFO: Saving data for HT40495: {'auction_closing_time': 1774885622.0, 'created_time': 1773861110.385504, 'last_price_update_time': 1774810886.939429}
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT40495') HTTP/1.1" 204 0
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-29 19:01:26 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-29 19:01:26 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-29 19:01:27 [auto1.nl] INFO: Scrape type for WR76222: 2
2026-03-29 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-29 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36efc695-9723-5bbd-905a-b337eba2b624 with scrape type 2
2026-03-29 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36efc695-9723-5bbd-905a-b337eba2b624 with scrape type 2
2026-03-29 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36efc695-9723-5bbd-905a-b337eba2b624, identifier: WR76222
2026-03-29 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-29 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-29 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222 to the API
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:32:10Z',
 'fuel_type': 'hybrid',
 'id': '36efc695-9723-5bbd-905a-b337eba2b624',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR76222',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 246899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-27',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-29 19:01:27 [auto1.nl] INFO: Saving data for WR76222: {'auction_closing_time': 1774884730.0, 'created_time': 1773231502.89427, 'last_price_update_time': 1774810887.440805}
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WR76222') HTTP/1.1" 204 0
2026-03-29 19:01:27 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-29 19:01:27 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-29 19:01:27 [auto1.nl] INFO: Scrape type for XY00413: 2
2026-03-29 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-29 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359e68c0-027b-5100-87fb-9c53256cd1c3 with scrape type 2
2026-03-29 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 359e68c0-027b-5100-87fb-9c53256cd1c3 with scrape type 2
2026-03-29 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 359e68c0-027b-5100-87fb-9c53256cd1c3, identifier: XY00413
2026-03-29 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-29 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-29 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413 to the API
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:53:42Z',
 'fuel_type': 'petrol',
 'id': '359e68c0-027b-5100-87fb-9c53256cd1c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY00413',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 76180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-18',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-29 19:01:27 [auto1.nl] INFO: Saving data for XY00413: {'auction_closing_time': 1774886022.0, 'created_time': 1774526468.820859, 'last_price_update_time': 1774810887.92506}
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY00413') HTTP/1.1" 204 0
2026-03-29 19:01:27 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-29 19:01:27 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-29 19:01:27 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-29 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-29 19:01:28 [auto1.nl] INFO: Scrape type for LA33547: 2
2026-03-29 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-29 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0056fd52-e843-5584-bf42-6c43c5b312ab with scrape type 2
2026-03-29 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0056fd52-e843-5584-bf42-6c43c5b312ab with scrape type 2
2026-03-29 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0056fd52-e843-5584-bf42-6c43c5b312ab, identifier: LA33547
2026-03-29 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-29 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-29 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547 to the API
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:30:08Z',
 'fuel_type': 'petrol',
 'id': '0056fd52-e843-5584-bf42-6c43c5b312ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA33547',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 252394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-29 19:01:28 [auto1.nl] INFO: Saving data for LA33547: {'auction_closing_time': 1774884608.0, 'created_time': 1774551627.625031, 'last_price_update_time': 1774810888.362977}
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA33547') HTTP/1.1" 204 0
2026-03-29 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:28 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-29 19:01:28 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-29 19:01:28 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-29 19:01:28 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-29 19:01:28 [auto1.nl] INFO: Scrape type for MX73700: 2
2026-03-29 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with identifier: MX73700
2026-03-29 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with scrape type 2
2026-03-29 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with scrape type 2
2026-03-29 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6, identifier: MX73700
2026-03-29 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with identifier: MX73700
2026-03-29 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with identifier: MX73700
2026-03-29 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b7e0e7a3-e6e0-5833-85c5-635e497ae8d6 with identifier: MX73700 to the API
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:18Z',
 'fuel_type': 'diesel',
 'id': 'b7e0e7a3-e6e0-5833-85c5-635e497ae8d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX73700',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 153076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-29 19:01:28 [auto1.nl] INFO: Saving data for MX73700: {'auction_closing_time': 1774883778.0, 'created_time': 1774033497.848266, 'last_price_update_time': 1774810888.789844}
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX73700') HTTP/1.1" 204 0
2026-03-29 19:01:28 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-29 19:01:28 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-29 19:01:28 [auto1.nl] INFO: Scrape type for KW64079: 2
2026-03-29 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e0f88a-207a-545c-98e5-0df16f7838e1 with identifier: KW64079
2026-03-29 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e0f88a-207a-545c-98e5-0df16f7838e1 with scrape type 2
2026-03-29 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e0f88a-207a-545c-98e5-0df16f7838e1 with scrape type 2
2026-03-29 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14e0f88a-207a-545c-98e5-0df16f7838e1, identifier: KW64079
2026-03-29 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14e0f88a-207a-545c-98e5-0df16f7838e1 with identifier: KW64079
2026-03-29 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14e0f88a-207a-545c-98e5-0df16f7838e1 with identifier: KW64079
2026-03-29 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14e0f88a-207a-545c-98e5-0df16f7838e1 with identifier: KW64079 to the API
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:49:18Z',
 'fuel_type': 'petrol',
 'id': '14e0f88a-207a-545c-98e5-0df16f7838e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW64079',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 64181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-22',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-29 19:01:29 [auto1.nl] INFO: Saving data for KW64079: {'auction_closing_time': 1774885758.0, 'created_time': 1773837182.527827, 'last_price_update_time': 1774810889.194159}
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KW64079') HTTP/1.1" 204 0
2026-03-29 19:01:29 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 758 | hits on page: 40
2026-03-29 19:01:29 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-29 19:01:29 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-29 19:01:29 [auto1.nl] INFO: Scrape type for GV91252: 2
2026-03-29 19:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c9e188-5648-52f7-a1ee-c16e25eccc93 with identifier: GV91252
2026-03-29 19:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c9e188-5648-52f7-a1ee-c16e25eccc93 with scrape type 2
2026-03-29 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0c9e188-5648-52f7-a1ee-c16e25eccc93 with scrape type 2
2026-03-29 19:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d0c9e188-5648-52f7-a1ee-c16e25eccc93, identifier: GV91252
2026-03-29 19:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d0c9e188-5648-52f7-a1ee-c16e25eccc93 with identifier: GV91252
2026-03-29 19:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d0c9e188-5648-52f7-a1ee-c16e25eccc93 with identifier: GV91252
2026-03-29 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d0c9e188-5648-52f7-a1ee-c16e25eccc93 with identifier: GV91252 to the API
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:31:51Z',
 'fuel_type': 'petrol',
 'id': 'd0c9e188-5648-52f7-a1ee-c16e25eccc93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV91252',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 90047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-29 19:01:29 [auto1.nl] INFO: Saving data for GV91252: {'auction_closing_time': 1774884711.0, 'created_time': 1774033370.121759, 'last_price_update_time': 1774810889.590922}
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV91252') HTTP/1.1" 204 0
2026-03-29 19:01:29 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-29 19:01:29 [auto1.nl] INFO: Scrape type for TY41517: 2
2026-03-29 19:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78222d7a-5039-5f46-b20e-8b0f641f13ac with identifier: TY41517
2026-03-29 19:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78222d7a-5039-5f46-b20e-8b0f641f13ac with scrape type 2
2026-03-29 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78222d7a-5039-5f46-b20e-8b0f641f13ac with scrape type 2
2026-03-29 19:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78222d7a-5039-5f46-b20e-8b0f641f13ac, identifier: TY41517
2026-03-29 19:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:29 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-29 19:01:29 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-29 19:01:29 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-29 19:01:29 [auto1.nl] INFO: Scrape type for VE70887: 0
2026-03-29 19:01:29 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-29 19:01:29 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-29 19:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78222d7a-5039-5f46-b20e-8b0f641f13ac with identifier: TY41517
2026-03-29 19:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78222d7a-5039-5f46-b20e-8b0f641f13ac with identifier: TY41517
2026-03-29 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78222d7a-5039-5f46-b20e-8b0f641f13ac with identifier: TY41517 to the API
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:53:49Z',
 'fuel_type': 'petrol',
 'id': '78222d7a-5039-5f46-b20e-8b0f641f13ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY41517',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 260582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-25',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-29 19:01:30 [auto1.nl] INFO: Saving data for TY41517: {'auction_closing_time': 1774886029.0, 'created_time': 1774724477.144047, 'last_price_update_time': 1774810890.105365}
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TY41517') HTTP/1.1" 204 0
2026-03-29 19:01:30 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-29 19:01:30 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-29 19:01:30 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-29 19:01:30 [auto1.nl] INFO: Scrape type for WP58537: 2
2026-03-29 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with identifier: WP58537
2026-03-29 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with scrape type 2
2026-03-29 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with scrape type 2
2026-03-29 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f, identifier: WP58537
2026-03-29 19:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with identifier: WP58537
2026-03-29 19:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with identifier: WP58537
2026-03-29 19:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8dc0f4c4-b632-5ad2-b262-8bbac2c4936f with identifier: WP58537 to the API
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:03:56Z',
 'fuel_type': 'diesel',
 'id': '8dc0f4c4-b632-5ad2-b262-8bbac2c4936f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP58537',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 73615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L1H2 HKa 3,5t',
 'transmission': 'manual',
 'trim': 'L1H2 HKa 3,5t',
 'year': 2018}
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-29 19:01:30 [auto1.nl] INFO: Saving data for WP58537: {'auction_closing_time': 1774883036.0, 'created_time': 1774724475.149691, 'last_price_update_time': 1774810890.491466}
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WP58537') HTTP/1.1" 204 0
2026-03-29 19:01:30 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-29 19:01:30 [auto1.nl] INFO: Scrape type for LE21715: 2
2026-03-29 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with identifier: LE21715
2026-03-29 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with scrape type 2
2026-03-29 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with scrape type 2
2026-03-29 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8, identifier: LE21715
2026-03-29 19:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with identifier: LE21715
2026-03-29 19:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with identifier: LE21715
2026-03-29 19:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b9f5fea6-0630-50af-9dc8-019eb0c6bdb8 with identifier: LE21715 to the API
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:47:19Z',
 'fuel_type': 'hybrid',
 'id': 'b9f5fea6-0630-50af-9dc8-019eb0c6bdb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE21715',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 223365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-29 19:01:30 [auto1.nl] INFO: Saving data for LE21715: {'auction_closing_time': 1774885639.0, 'created_time': 1774353780.300876, 'last_price_update_time': 1774810890.886581}
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE21715') HTTP/1.1" 204 0
2026-03-29 19:01:30 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-29 19:01:30 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-29 19:01:30 [auto1.nl] INFO: Scrape type for JH71745: 0
2026-03-29 19:01:30 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-29 19:01:30 [auto1.nl] INFO: Scrape type for BL89669: 2
2026-03-29 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b86ec01d-ddd3-5506-99fe-df6a570f211f with identifier: BL89669
2026-03-29 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b86ec01d-ddd3-5506-99fe-df6a570f211f with scrape type 2
2026-03-29 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b86ec01d-ddd3-5506-99fe-df6a570f211f with scrape type 2
2026-03-29 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b86ec01d-ddd3-5506-99fe-df6a570f211f, identifier: BL89669
2026-03-29 19:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b86ec01d-ddd3-5506-99fe-df6a570f211f with identifier: BL89669
2026-03-29 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b86ec01d-ddd3-5506-99fe-df6a570f211f with identifier: BL89669
2026-03-29 19:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b86ec01d-ddd3-5506-99fe-df6a570f211f with identifier: BL89669 to the API
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:55Z',
 'fuel_type': 'petrol',
 'id': 'b86ec01d-ddd3-5506-99fe-df6a570f211f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL89669',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 245384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Take up!',
 'transmission': 'manual',
 'trim': 'Take',
 'year': 2012}
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-29 19:01:31 [auto1.nl] INFO: Saving data for BL89669: {'auction_closing_time': 1774884475.0, 'created_time': 1774551714.699669, 'last_price_update_time': 1774810891.82482}
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BL89669') HTTP/1.1" 204 0
2026-03-29 19:01:31 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-29 19:01:31 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-29 19:01:31 [auto1.nl] INFO: Scrape type for HN54837: 0
2026-03-29 19:01:31 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-29 19:01:31 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-29 19:01:31 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-29 19:01:31 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-29 19:01:31 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-29 19:01:31 [auto1.nl] INFO: Scrape type for XK63885: 0
2026-03-29 19:01:31 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-29 19:01:31 [auto1.nl] INFO: Scrape type for BJ61509: 2
2026-03-29 19:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with identifier: BJ61509
2026-03-29 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with scrape type 2
2026-03-29 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with scrape type 2
2026-03-29 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2, identifier: BJ61509
2026-03-29 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with identifier: BJ61509
2026-03-29 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with identifier: BJ61509
2026-03-29 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b4a82bc-7f32-57c0-b814-d577ab4e12c2 with identifier: BJ61509 to the API
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:54:31Z',
 'fuel_type': 'petrol',
 'id': '2b4a82bc-7f32-57c0-b814-d577ab4e12c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ61509',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 102560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-13',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-29 19:01:32 [auto1.nl] INFO: Saving data for BJ61509: {'auction_closing_time': 1774886071.0, 'created_time': 1774724490.814595, 'last_price_update_time': 1774810892.354021}
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BJ61509') HTTP/1.1" 204 0
2026-03-29 19:01:32 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-29 19:01:32 [auto1.nl] INFO: Scrape type for RH72913: 2
2026-03-29 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea900f9-9624-56bd-8cce-b2b86fa08718 with identifier: RH72913
2026-03-29 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea900f9-9624-56bd-8cce-b2b86fa08718 with scrape type 2
2026-03-29 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea900f9-9624-56bd-8cce-b2b86fa08718 with scrape type 2
2026-03-29 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ea900f9-9624-56bd-8cce-b2b86fa08718, identifier: RH72913
2026-03-29 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ea900f9-9624-56bd-8cce-b2b86fa08718 with identifier: RH72913
2026-03-29 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ea900f9-9624-56bd-8cce-b2b86fa08718 with identifier: RH72913
2026-03-29 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ea900f9-9624-56bd-8cce-b2b86fa08718 with identifier: RH72913 to the API
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:29:42Z',
 'fuel_type': 'petrol',
 'id': '9ea900f9-9624-56bd-8cce-b2b86fa08718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH72913',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 256304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-29 19:01:32 [auto1.nl] INFO: Saving data for RH72913: {'auction_closing_time': 1774884582.0, 'created_time': 1774724479.189296, 'last_price_update_time': 1774810892.770435}
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RH72913') HTTP/1.1" 204 0
2026-03-29 19:01:32 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-29 19:01:32 [auto1.nl] INFO: Scrape type for SR45817: 0
2026-03-29 19:01:32 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-29 19:01:32 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-29 19:01:32 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-29 19:01:32 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-29 19:01:32 [auto1.nl] INFO: Scrape type for EC40520: 0
2026-03-29 19:01:32 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-29 19:01:32 [auto1.nl] INFO: Scrape type for LL30088: 2
2026-03-29 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with identifier: LL30088
2026-03-29 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with scrape type 2
2026-03-29 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with scrape type 2
2026-03-29 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb, identifier: LL30088
2026-03-29 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with identifier: LL30088
2026-03-29 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with identifier: LL30088
2026-03-29 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b73042b-cd7f-557a-83c4-ab3b0db13fbb with identifier: LL30088 to the API
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:17:41Z',
 'fuel_type': 'petrol',
 'id': '6b73042b-cd7f-557a-83c4-ab3b0db13fbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL30088',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 87734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-14',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2010}
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-29 19:01:33 [auto1.nl] INFO: Saving data for LL30088: {'auction_closing_time': 1774883861.0, 'created_time': 1774724487.405923, 'last_price_update_time': 1774810893.228594}
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LL30088') HTTP/1.1" 204 0
2026-03-29 19:01:33 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-29 19:01:33 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-29 19:01:33 [auto1.nl] INFO: Scrape type for SN61945: 2
2026-03-29 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e52919-9fef-5265-9a67-09711ed53cd2 with identifier: SN61945
2026-03-29 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e52919-9fef-5265-9a67-09711ed53cd2 with scrape type 2
2026-03-29 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e52919-9fef-5265-9a67-09711ed53cd2 with scrape type 2
2026-03-29 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7e52919-9fef-5265-9a67-09711ed53cd2, identifier: SN61945
2026-03-29 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7e52919-9fef-5265-9a67-09711ed53cd2 with identifier: SN61945
2026-03-29 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7e52919-9fef-5265-9a67-09711ed53cd2 with identifier: SN61945
2026-03-29 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7e52919-9fef-5265-9a67-09711ed53cd2 with identifier: SN61945 to the API
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:26:07Z',
 'fuel_type': 'petrol',
 'id': 'e7e52919-9fef-5265-9a67-09711ed53cd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN61945',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 59316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-09',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-29 19:01:33 [auto1.nl] INFO: Saving data for SN61945: {'auction_closing_time': 1774884367.0, 'created_time': 1774724490.097032, 'last_price_update_time': 1774810893.712921}
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SN61945') HTTP/1.1" 204 0
2026-03-29 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:33 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-29 19:01:33 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-29 19:01:33 [auto1.nl] INFO: Scrape type for ZK31432: 2
2026-03-29 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4caaada7-42c8-5550-b0b5-915cb3d30272 with identifier: ZK31432
2026-03-29 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4caaada7-42c8-5550-b0b5-915cb3d30272 with scrape type 2
2026-03-29 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4caaada7-42c8-5550-b0b5-915cb3d30272 with scrape type 2
2026-03-29 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4caaada7-42c8-5550-b0b5-915cb3d30272, identifier: ZK31432
2026-03-29 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4caaada7-42c8-5550-b0b5-915cb3d30272 with identifier: ZK31432
2026-03-29 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4caaada7-42c8-5550-b0b5-915cb3d30272 with identifier: ZK31432
2026-03-29 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4caaada7-42c8-5550-b0b5-915cb3d30272 with identifier: ZK31432 to the API
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:11:49Z',
 'fuel_type': 'diesel',
 'id': '4caaada7-42c8-5550-b0b5-915cb3d30272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK31432',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 200768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-22',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-29 19:01:34 [auto1.nl] INFO: Saving data for ZK31432: {'auction_closing_time': 1774883509.0, 'created_time': 1774724492.226778, 'last_price_update_time': 1774810894.103832}
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK31432') HTTP/1.1" 204 0
2026-03-29 19:01:34 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-29 19:01:34 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-29 19:01:34 [auto1.nl] INFO: Scrape type for GN14496: 0
2026-03-29 19:01:34 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-29 19:01:34 [auto1.nl] INFO: Scrape type for WH58354: 2
2026-03-29 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc5b17a-759a-50de-bbee-5d90c711bc03 with identifier: WH58354
2026-03-29 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc5b17a-759a-50de-bbee-5d90c711bc03 with scrape type 2
2026-03-29 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cc5b17a-759a-50de-bbee-5d90c711bc03 with scrape type 2
2026-03-29 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9cc5b17a-759a-50de-bbee-5d90c711bc03, identifier: WH58354
2026-03-29 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9cc5b17a-759a-50de-bbee-5d90c711bc03 with identifier: WH58354
2026-03-29 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9cc5b17a-759a-50de-bbee-5d90c711bc03 with identifier: WH58354
2026-03-29 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9cc5b17a-759a-50de-bbee-5d90c711bc03 with identifier: WH58354 to the API
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:42:56Z',
 'fuel_type': 'petrol',
 'id': '9cc5b17a-759a-50de-bbee-5d90c711bc03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH58354',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 111621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 400 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-29 19:01:34 [auto1.nl] INFO: Saving data for WH58354: {'auction_closing_time': 1774885376.0, 'created_time': 1773924618.638592, 'last_price_update_time': 1774810894.556513}
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WH58354') HTTP/1.1" 204 0
2026-03-29 19:01:34 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 758 | hits on page: 40
2026-03-29 19:01:34 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-29 19:01:34 [auto1.nl] INFO: Scrape type for VZ88435: 2
2026-03-29 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f61b0cf8-f116-5867-9034-165288e35185 with identifier: VZ88435
2026-03-29 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f61b0cf8-f116-5867-9034-165288e35185 with scrape type 2
2026-03-29 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f61b0cf8-f116-5867-9034-165288e35185 with scrape type 2
2026-03-29 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f61b0cf8-f116-5867-9034-165288e35185, identifier: VZ88435
2026-03-29 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f61b0cf8-f116-5867-9034-165288e35185 with identifier: VZ88435
2026-03-29 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f61b0cf8-f116-5867-9034-165288e35185 with identifier: VZ88435
2026-03-29 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f61b0cf8-f116-5867-9034-165288e35185 with identifier: VZ88435 to the API
2026-03-29 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:05:14Z',
 'fuel_type': 'petrol',
 'id': 'f61b0cf8-f116-5867-9034-165288e35185',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ88435',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 325294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-01',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Saving data for VZ88435: {'auction_closing_time': 1774883114.0, 'created_time': 1774724481.833489, 'last_price_update_time': 1774810895.780104}
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VZ88435') HTTP/1.1" 204 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Scrape type for VZ65695: 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Scrape type for GU70185: 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Scrape type for GD33520: 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Scrape type for PS01910: 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Scrape type for AB54003: 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Scrape type for HD36341: 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Scrape type for JA81822: 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-29 19:01:35 [auto1.nl] INFO: Scrape type for JA39510: 0
2026-03-29 19:01:35 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-29 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-29 19:01:36 [auto1.nl] INFO: Scrape type for AD33035: 2
2026-03-29 19:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40f51b58-64e3-522b-b353-cfb584ce0272 with identifier: AD33035
2026-03-29 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40f51b58-64e3-522b-b353-cfb584ce0272 with scrape type 2
2026-03-29 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40f51b58-64e3-522b-b353-cfb584ce0272 with scrape type 2
2026-03-29 19:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40f51b58-64e3-522b-b353-cfb584ce0272, identifier: AD33035
2026-03-29 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:36 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK58084%27 HTTP/1.1" 200 None
2026-03-29 19:01:36 [auto1.nl] INFO: Scrape type for ZK58084: 0
2026-03-29 19:01:36 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-29 19:01:36 [auto1.nl] INFO: Scrape type for ZN70459: 2
2026-03-29 19:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47753836-04a1-5002-928e-0723ecea2118 with identifier: ZN70459
2026-03-29 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47753836-04a1-5002-928e-0723ecea2118 with scrape type 2
2026-03-29 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47753836-04a1-5002-928e-0723ecea2118 with scrape type 2
2026-03-29 19:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 47753836-04a1-5002-928e-0723ecea2118, identifier: ZN70459
2026-03-29 19:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40f51b58-64e3-522b-b353-cfb584ce0272 with identifier: AD33035
2026-03-29 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40f51b58-64e3-522b-b353-cfb584ce0272 with identifier: AD33035
2026-03-29 19:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40f51b58-64e3-522b-b353-cfb584ce0272 with identifier: AD33035 to the API
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:44:37Z',
 'fuel_type': 'petrol',
 'id': '40f51b58-64e3-522b-b353-cfb584ce0272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD33035',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 87074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-12',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Take up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Take  BlueMotion Tech',
 'year': 2016}
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-29 19:01:36 [auto1.nl] INFO: Saving data for AD33035: {'auction_closing_time': 1774885477.0, 'created_time': 1774724493.704316, 'last_price_update_time': 1774810896.546509}
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AD33035') HTTP/1.1" 204 0
2026-03-29 19:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 47753836-04a1-5002-928e-0723ecea2118 with identifier: ZN70459
2026-03-29 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 47753836-04a1-5002-928e-0723ecea2118 with identifier: ZN70459
2026-03-29 19:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 47753836-04a1-5002-928e-0723ecea2118 with identifier: ZN70459 to the API
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:21:15Z',
 'fuel_type': 'petrol',
 'id': '47753836-04a1-5002-928e-0723ecea2118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN70459',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 176453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-29 19:01:36 [auto1.nl] INFO: Saving data for ZN70459: {'auction_closing_time': 1774884075.0, 'created_time': 1774724489.515796, 'last_price_update_time': 1774810896.996272}
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZN70459') HTTP/1.1" 204 0
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-29 19:01:37 [auto1.nl] INFO: Scrape type for NJ31093: 0
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-29 19:01:37 [auto1.nl] INFO: Scrape type for YZ13462: 2
2026-03-29 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823386a8-c007-5b12-9207-3a4ec4d5060d with identifier: YZ13462
2026-03-29 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823386a8-c007-5b12-9207-3a4ec4d5060d with scrape type 2
2026-03-29 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 823386a8-c007-5b12-9207-3a4ec4d5060d with scrape type 2
2026-03-29 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 823386a8-c007-5b12-9207-3a4ec4d5060d, identifier: YZ13462
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-29 19:01:37 [auto1.nl] INFO: Scrape type for FE67699: 2
2026-03-29 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e25974-08fb-59db-864b-3f609a5f4900 with identifier: FE67699
2026-03-29 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e25974-08fb-59db-864b-3f609a5f4900 with scrape type 2
2026-03-29 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e25974-08fb-59db-864b-3f609a5f4900 with scrape type 2
2026-03-29 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56e25974-08fb-59db-864b-3f609a5f4900, identifier: FE67699
2026-03-29 19:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 823386a8-c007-5b12-9207-3a4ec4d5060d with identifier: YZ13462
2026-03-29 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 823386a8-c007-5b12-9207-3a4ec4d5060d with identifier: YZ13462
2026-03-29 19:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 823386a8-c007-5b12-9207-3a4ec4d5060d with identifier: YZ13462 to the API
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-30T15:28:24Z',
 'fuel_type': 'hybrid',
 'id': '823386a8-c007-5b12-9207-3a4ec4d5060d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ13462',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 208100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2017}
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-29 19:01:37 [auto1.nl] INFO: Saving data for YZ13462: {'auction_closing_time': 1774884504.0, 'created_time': 1773860701.62698, 'last_price_update_time': 1774810897.605902}
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ13462') HTTP/1.1" 204 0
2026-03-29 19:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56e25974-08fb-59db-864b-3f609a5f4900 with identifier: FE67699
2026-03-29 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56e25974-08fb-59db-864b-3f609a5f4900 with identifier: FE67699
2026-03-29 19:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56e25974-08fb-59db-864b-3f609a5f4900 with identifier: FE67699 to the API
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:49:26Z',
 'fuel_type': 'petrol',
 'id': '56e25974-08fb-59db-864b-3f609a5f4900',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE67699',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 121743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-05',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 FIFA World Cup',
 'transmission': 'manual',
 'trim': 'FIFA World Cup',
 'year': 2006}
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-29 19:01:37 [auto1.nl] INFO: Saving data for FE67699: {'auction_closing_time': 1774885766.0, 'created_time': 1774724486.229651, 'last_price_update_time': 1774810897.90218}
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE67699') HTTP/1.1" 204 0
2026-03-29 19:01:37 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-29 19:01:37 [auto1.nl] INFO: Scrape type for LE06198: 2
2026-03-29 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1bedc77-12f4-5458-be21-8378521c399a with identifier: LE06198
2026-03-29 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bedc77-12f4-5458-be21-8378521c399a with scrape type 2
2026-03-29 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1bedc77-12f4-5458-be21-8378521c399a with scrape type 2
2026-03-29 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1bedc77-12f4-5458-be21-8378521c399a, identifier: LE06198
2026-03-29 19:01:38 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-29 19:01:38 [auto1.nl] INFO: Scrape type for XU82529: 0
2026-03-29 19:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1bedc77-12f4-5458-be21-8378521c399a with identifier: LE06198
2026-03-29 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1bedc77-12f4-5458-be21-8378521c399a with identifier: LE06198
2026-03-29 19:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1bedc77-12f4-5458-be21-8378521c399a with identifier: LE06198 to the API
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'petrol',
 'id': 'c1bedc77-12f4-5458-be21-8378521c399a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE06198',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 296356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-27',
 'seller_name': None,
 'title': 'Ford S-Max 2.5 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-29 19:01:38 [auto1.nl] INFO: Saving data for LE06198: {'auction_closing_time': 1774885682.0, 'created_time': 1774724488.178187, 'last_price_update_time': 1774810898.34661}
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE06198') HTTP/1.1" 204 0
2026-03-29 19:01:38 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-29 19:01:38 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-29 19:01:38 [auto1.nl] INFO: Scrape type for HW32084: 2
2026-03-29 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2323dac1-0e73-5dbf-8093-7e25247de99c with identifier: HW32084
2026-03-29 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2323dac1-0e73-5dbf-8093-7e25247de99c with scrape type 2
2026-03-29 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2323dac1-0e73-5dbf-8093-7e25247de99c with scrape type 2
2026-03-29 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2323dac1-0e73-5dbf-8093-7e25247de99c, identifier: HW32084
2026-03-29 19:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2323dac1-0e73-5dbf-8093-7e25247de99c with identifier: HW32084
2026-03-29 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2323dac1-0e73-5dbf-8093-7e25247de99c with identifier: HW32084
2026-03-29 19:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2323dac1-0e73-5dbf-8093-7e25247de99c with identifier: HW32084 to the API
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-30T15:16:22Z',
 'fuel_type': 'petrol',
 'id': '2323dac1-0e73-5dbf-8093-7e25247de99c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW32084',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 154003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2019}
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-29 19:01:38 [auto1.nl] INFO: Saving data for HW32084: {'auction_closing_time': 1774883782.0, 'created_time': 1774724495.869126, 'last_price_update_time': 1774810898.891852}
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW32084') HTTP/1.1" 204 0
2026-03-29 19:01:38 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-29 19:01:38 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-29 19:01:38 [auto1.nl] INFO: Scrape type for EW29368: 2
2026-03-29 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88954a77-5ac5-5492-89f5-094d7dabda53 with identifier: EW29368
2026-03-29 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88954a77-5ac5-5492-89f5-094d7dabda53 with scrape type 2
2026-03-29 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88954a77-5ac5-5492-89f5-094d7dabda53 with scrape type 2
2026-03-29 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 88954a77-5ac5-5492-89f5-094d7dabda53, identifier: EW29368
2026-03-29 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 88954a77-5ac5-5492-89f5-094d7dabda53 with identifier: EW29368
2026-03-29 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 88954a77-5ac5-5492-89f5-094d7dabda53 with identifier: EW29368
2026-03-29 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 88954a77-5ac5-5492-89f5-094d7dabda53 with identifier: EW29368 to the API
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:51:53Z',
 'fuel_type': 'petrol',
 'id': '88954a77-5ac5-5492-89f5-094d7dabda53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW29368',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 180738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TFSI quattro Ambiente',
 'transmission': 'automatic',
 'trim': 'quattro Ambiente',
 'year': 2011}
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-29 19:01:39 [auto1.nl] INFO: Saving data for EW29368: {'auction_closing_time': 1774885913.0, 'created_time': 1774724488.56095, 'last_price_update_time': 1774810899.322541}
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EW29368') HTTP/1.1" 204 0
2026-03-29 19:01:39 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-29 19:01:39 [auto1.nl] INFO: Scrape type for UW56966: 2
2026-03-29 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a598defa-a3f7-57c5-9199-3f9a63af0959 with identifier: UW56966
2026-03-29 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a598defa-a3f7-57c5-9199-3f9a63af0959 with scrape type 2
2026-03-29 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a598defa-a3f7-57c5-9199-3f9a63af0959 with scrape type 2
2026-03-29 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a598defa-a3f7-57c5-9199-3f9a63af0959, identifier: UW56966
2026-03-29 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a598defa-a3f7-57c5-9199-3f9a63af0959 with identifier: UW56966
2026-03-29 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a598defa-a3f7-57c5-9199-3f9a63af0959 with identifier: UW56966
2026-03-29 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a598defa-a3f7-57c5-9199-3f9a63af0959 with identifier: UW56966 to the API
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'petrol',
 'id': 'a598defa-a3f7-57c5-9199-3f9a63af0959',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW56966',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 69650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-29 19:01:39 [auto1.nl] INFO: Saving data for UW56966: {'auction_closing_time': 1774884503.0, 'created_time': 1774033498.196156, 'last_price_update_time': 1774810899.773062}
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UW56966') HTTP/1.1" 204 0
2026-03-29 19:01:39 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-29 19:01:39 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-29 19:01:39 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-29 19:01:39 [auto1.nl] INFO: Scrape type for YF94322: 2
2026-03-29 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with identifier: YF94322
2026-03-29 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with scrape type 2
2026-03-29 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with scrape type 2
2026-03-29 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2841a04c-73fe-5aa2-89b8-40ddb3f00802, identifier: YF94322
2026-03-29 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with identifier: YF94322
2026-03-29 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with identifier: YF94322
2026-03-29 19:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2841a04c-73fe-5aa2-89b8-40ddb3f00802 with identifier: YF94322 to the API
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:28Z',
 'fuel_type': 'petrol',
 'id': '2841a04c-73fe-5aa2-89b8-40ddb3f00802',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF94322',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 72692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-29 19:01:40 [auto1.nl] INFO: Saving data for YF94322: {'auction_closing_time': 1774884148.0, 'created_time': 1774551751.547652, 'last_price_update_time': 1774810900.210919}
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YF94322') HTTP/1.1" 204 0
2026-03-29 19:01:40 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-29 19:01:40 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-29 19:01:40 [auto1.nl] INFO: Scrape type for PK76759: 2
2026-03-29 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd23808-ff64-5851-853c-f5825419ed70 with identifier: PK76759
2026-03-29 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd23808-ff64-5851-853c-f5825419ed70 with scrape type 2
2026-03-29 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd23808-ff64-5851-853c-f5825419ed70 with scrape type 2
2026-03-29 19:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4fd23808-ff64-5851-853c-f5825419ed70, identifier: PK76759
2026-03-29 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4fd23808-ff64-5851-853c-f5825419ed70 with identifier: PK76759
2026-03-29 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4fd23808-ff64-5851-853c-f5825419ed70 with identifier: PK76759
2026-03-29 19:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4fd23808-ff64-5851-853c-f5825419ed70 with identifier: PK76759 to the API
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:52:10Z',
 'fuel_type': 'petrol',
 'id': '4fd23808-ff64-5851-853c-f5825419ed70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK76759',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 219918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-24',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 3.3 V6 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2008}
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-29 19:01:40 [auto1.nl] INFO: Saving data for PK76759: {'auction_closing_time': 1774885930.0, 'created_time': 1774699294.295042, 'last_price_update_time': 1774810900.678546}
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PK76759') HTTP/1.1" 204 0
2026-03-29 19:01:40 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-29 19:01:40 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-29 19:01:40 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-29 19:01:40 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-29 19:01:40 [auto1.nl] INFO: Scrape type for GA63942: 0
2026-03-29 19:01:40 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-29 19:01:40 [auto1.nl] INFO: Scrape type for XH80509: 2
2026-03-29 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b26de1a-f963-5b9a-8aac-8f401962dc78 with identifier: XH80509
2026-03-29 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b26de1a-f963-5b9a-8aac-8f401962dc78 with scrape type 2
2026-03-29 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b26de1a-f963-5b9a-8aac-8f401962dc78 with scrape type 2
2026-03-29 19:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0b26de1a-f963-5b9a-8aac-8f401962dc78, identifier: XH80509
2026-03-29 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0b26de1a-f963-5b9a-8aac-8f401962dc78 with identifier: XH80509
2026-03-29 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0b26de1a-f963-5b9a-8aac-8f401962dc78 with identifier: XH80509
2026-03-29 19:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0b26de1a-f963-5b9a-8aac-8f401962dc78 with identifier: XH80509 to the API
2026-03-29 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:09Z',
 'fuel_type': 'petrol',
 'id': '0b26de1a-f963-5b9a-8aac-8f401962dc78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH80509',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 125622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-29 19:01:41 [auto1.nl] INFO: Saving data for XH80509: {'auction_closing_time': 1774884429.0, 'created_time': 1774699292.929599, 'last_price_update_time': 1774810901.114111}
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XH80509') HTTP/1.1" 204 0
2026-03-29 19:01:41 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-29 19:01:41 [auto1.nl] INFO: Scrape type for ND88147: 0
2026-03-29 19:01:41 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-29 19:01:41 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-29 19:01:41 [auto1.nl] INFO: Scrape type for WE18316: 2
2026-03-29 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1386a4f0-7c91-5d56-9a22-08d976b0d64b with identifier: WE18316
2026-03-29 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b with scrape type 2
2026-03-29 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1386a4f0-7c91-5d56-9a22-08d976b0d64b with scrape type 2
2026-03-29 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1386a4f0-7c91-5d56-9a22-08d976b0d64b, identifier: WE18316
2026-03-29 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1386a4f0-7c91-5d56-9a22-08d976b0d64b with identifier: WE18316
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-29 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1386a4f0-7c91-5d56-9a22-08d976b0d64b with identifier: WE18316
2026-03-29 19:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1386a4f0-7c91-5d56-9a22-08d976b0d64b with identifier: WE18316 to the API
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:40:06Z',
 'fuel_type': 'electro',
 'id': '1386a4f0-7c91-5d56-9a22-08d976b0d64b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE18316',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 148029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2019}
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-29 19:01:41 [auto1.nl] INFO: Saving data for WE18316: {'auction_closing_time': 1774885206.0, 'created_time': 1774699291.021438, 'last_price_update_time': 1774810901.821369}
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WE18316') HTTP/1.1" 204 0
2026-03-29 19:01:41 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-29 19:01:41 [auto1.nl] INFO: Scrape type for SS74343: 2
2026-03-29 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with identifier: SS74343
2026-03-29 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with scrape type 2
2026-03-29 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with scrape type 2
2026-03-29 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70, identifier: SS74343
2026-03-29 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with identifier: SS74343
2026-03-29 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with identifier: SS74343
2026-03-29 19:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 555c30f3-d3a7-5ff0-85ac-178ad0e69d70 with identifier: SS74343 to the API
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:21Z',
 'fuel_type': 'petrol',
 'id': '555c30f3-d3a7-5ff0-85ac-178ad0e69d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS74343',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 117641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-08',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2007}
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-29 19:01:42 [auto1.nl] INFO: Saving data for SS74343: {'auction_closing_time': 1774884921.0, 'created_time': 1774699289.666438, 'last_price_update_time': 1774810902.758729}
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SS74343') HTTP/1.1" 204 0
2026-03-29 19:01:42 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-29 19:01:42 [auto1.nl] INFO: Scrape type for YZ60467: 0
2026-03-29 19:01:42 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-29 19:01:42 [auto1.nl] INFO: Scrape type for MZ09465: 2
2026-03-29 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 426a13f9-a2cd-50b3-b345-1f62e662d16a with identifier: MZ09465
2026-03-29 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 426a13f9-a2cd-50b3-b345-1f62e662d16a with scrape type 2
2026-03-29 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 426a13f9-a2cd-50b3-b345-1f62e662d16a with scrape type 2
2026-03-29 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 426a13f9-a2cd-50b3-b345-1f62e662d16a, identifier: MZ09465
2026-03-29 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 426a13f9-a2cd-50b3-b345-1f62e662d16a with identifier: MZ09465
2026-03-29 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 426a13f9-a2cd-50b3-b345-1f62e662d16a with identifier: MZ09465
2026-03-29 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 426a13f9-a2cd-50b3-b345-1f62e662d16a with identifier: MZ09465 to the API
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:59:14Z',
 'fuel_type': 'petrol',
 'id': '426a13f9-a2cd-50b3-b345-1f62e662d16a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ09465',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 188410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-14',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.8 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2010}
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-29 19:01:43 [auto1.nl] INFO: Saving data for MZ09465: {'auction_closing_time': 1774886354.0, 'created_time': 1774699286.986207, 'last_price_update_time': 1774810903.180045}
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ09465') HTTP/1.1" 204 0
2026-03-29 19:01:43 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 758 | hits on page: 40
2026-03-29 19:01:43 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-29 19:01:43 [auto1.nl] INFO: Scrape type for EG04578: 2
2026-03-29 19:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e138907-1898-58c8-850b-a799c8ed88b0 with identifier: EG04578
2026-03-29 19:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e138907-1898-58c8-850b-a799c8ed88b0 with scrape type 2
2026-03-29 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e138907-1898-58c8-850b-a799c8ed88b0 with scrape type 2
2026-03-29 19:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e138907-1898-58c8-850b-a799c8ed88b0, identifier: EG04578
2026-03-29 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e138907-1898-58c8-850b-a799c8ed88b0 with identifier: EG04578
2026-03-29 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e138907-1898-58c8-850b-a799c8ed88b0 with identifier: EG04578
2026-03-29 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e138907-1898-58c8-850b-a799c8ed88b0 with identifier: EG04578 to the API
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 173,
 'expiration_date': '2026-03-30T15:08:17Z',
 'fuel_type': 'diesel',
 'id': '7e138907-1898-58c8-850b-a799c8ed88b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG04578',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 158628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-31',
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 D-4D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-29 19:01:43 [auto1.nl] INFO: Saving data for EG04578: {'auction_closing_time': 1774883297.0, 'created_time': 1774699298.093054, 'last_price_update_time': 1774810903.597638}
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG04578') HTTP/1.1" 204 0
2026-03-29 19:01:43 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-29 19:01:43 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-29 19:01:43 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-29 19:01:43 [auto1.nl] INFO: Scrape type for PJ49676: 0
2026-03-29 19:01:43 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-29 19:01:43 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-29 19:01:43 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-29 19:01:43 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-29 19:01:43 [auto1.nl] INFO: Scrape type for TL29950: 2
2026-03-29 19:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-29 19:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with scrape type 2
2026-03-29 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with scrape type 2
2026-03-29 19:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba, identifier: TL29950
2026-03-29 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-29 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-29 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950 to the API
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:27Z',
 'fuel_type': 'diesel',
 'id': '9b60e987-fe57-5b5c-a6d8-87cfa55627ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL29950',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 228514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2019}
2026-03-29 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Saving data for TL29950: {'auction_closing_time': 1774882887.0, 'created_time': 1774526497.448378, 'last_price_update_time': 1774810904.007318}
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TL29950') HTTP/1.1" 204 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for GZ48867: 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for ZB71006: 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for DU11939: 2
2026-03-29 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-29 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891d58cf-ee3b-5e74-90bd-b087b7f63344 with scrape type 2
2026-03-29 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 891d58cf-ee3b-5e74-90bd-b087b7f63344 with scrape type 2
2026-03-29 19:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 891d58cf-ee3b-5e74-90bd-b087b7f63344, identifier: DU11939
2026-03-29 19:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-29 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-29 19:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939 to the API
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:18:15Z',
 'fuel_type': 'petrol',
 'id': '891d58cf-ee3b-5e74-90bd-b087b7f63344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU11939',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 149308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-20',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2008}
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Saving data for DU11939: {'auction_closing_time': 1774883895.0, 'created_time': 1774378883.943602, 'last_price_update_time': 1774810904.533374}
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU11939') HTTP/1.1" 204 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for KK51574: 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for AK27162: 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for KX15971: 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for MV10901: 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for ZT51900: 0
2026-03-29 19:01:44 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-29 19:01:44 [auto1.nl] INFO: Scrape type for GN27243: 2
2026-03-29 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ebb51e1-b300-5445-82c2-a5d3f157c222 with identifier: GN27243
2026-03-29 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ebb51e1-b300-5445-82c2-a5d3f157c222 with scrape type 2
2026-03-29 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ebb51e1-b300-5445-82c2-a5d3f157c222 with scrape type 2
2026-03-29 19:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ebb51e1-b300-5445-82c2-a5d3f157c222, identifier: GN27243
2026-03-29 19:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ebb51e1-b300-5445-82c2-a5d3f157c222 with identifier: GN27243
2026-03-29 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ebb51e1-b300-5445-82c2-a5d3f157c222 with identifier: GN27243
2026-03-29 19:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ebb51e1-b300-5445-82c2-a5d3f157c222 with identifier: GN27243 to the API
2026-03-29 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:22:19Z',
 'fuel_type': 'petrol',
 'id': '7ebb51e1-b300-5445-82c2-a5d3f157c222',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN27243',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 108608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-17',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-29 19:01:45 [auto1.nl] INFO: Saving data for GN27243: {'auction_closing_time': 1774884139.0, 'created_time': 1774699304.055155, 'last_price_update_time': 1774810905.128043}
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN27243') HTTP/1.1" 204 0
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-29 19:01:45 [auto1.nl] INFO: Scrape type for NU66962: 0
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-29 19:01:45 [auto1.nl] INFO: Scrape type for VY08351: 2
2026-03-29 19:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26058572-de28-5718-8611-83e2ce98a669 with identifier: VY08351
2026-03-29 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26058572-de28-5718-8611-83e2ce98a669 with scrape type 2
2026-03-29 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26058572-de28-5718-8611-83e2ce98a669 with scrape type 2
2026-03-29 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 26058572-de28-5718-8611-83e2ce98a669, identifier: VY08351
2026-03-29 19:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 26058572-de28-5718-8611-83e2ce98a669 with identifier: VY08351
2026-03-29 19:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 26058572-de28-5718-8611-83e2ce98a669 with identifier: VY08351
2026-03-29 19:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 26058572-de28-5718-8611-83e2ce98a669 with identifier: VY08351 to the API
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:04Z',
 'fuel_type': 'diesel',
 'id': '26058572-de28-5718-8611-83e2ce98a669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY08351',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 239020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2020}
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-29 19:01:45 [auto1.nl] INFO: Saving data for VY08351: {'auction_closing_time': 1774883584.0, 'created_time': 1774699304.771174, 'last_price_update_time': 1774810905.631095}
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VY08351') HTTP/1.1" 204 0
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-29 19:01:45 [auto1.nl] INFO: Scrape type for XR71865: 0
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-29 19:01:45 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-29 19:01:45 [auto1.nl] INFO: Scrape type for YA06880: 0
2026-03-29 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:46 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 758 | hits on page: 40
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-29 19:01:46 [auto1.nl] INFO: Scrape type for SE60245: 0
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-29 19:01:46 [auto1.nl] INFO: Scrape type for KL38892: 0
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-29 19:01:46 [auto1.nl] INFO: Scrape type for TW61693: 0
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-29 19:01:46 [auto1.nl] INFO: Scrape type for SE95402: 0
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-29 19:01:46 [auto1.nl] INFO: Scrape type for RK78214: 0
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-29 19:01:46 [auto1.nl] INFO: Scrape type for EW45242: 0
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-29 19:01:46 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-29 19:01:46 [auto1.nl] INFO: Scrape type for UA80107: 2
2026-03-29 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2544507b-6f15-57b8-afb9-35cb3bd731b5 with identifier: UA80107
2026-03-29 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2544507b-6f15-57b8-afb9-35cb3bd731b5 with scrape type 2
2026-03-29 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2544507b-6f15-57b8-afb9-35cb3bd731b5 with scrape type 2
2026-03-29 19:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2544507b-6f15-57b8-afb9-35cb3bd731b5, identifier: UA80107
2026-03-29 19:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2544507b-6f15-57b8-afb9-35cb3bd731b5 with identifier: UA80107
2026-03-29 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2544507b-6f15-57b8-afb9-35cb3bd731b5 with identifier: UA80107
2026-03-29 19:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2544507b-6f15-57b8-afb9-35cb3bd731b5 with identifier: UA80107 to the API
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:34:47Z',
 'fuel_type': 'diesel',
 'id': '2544507b-6f15-57b8-afb9-35cb3bd731b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA80107',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 361014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 290 L2',
 'transmission': 'manual',
 'trim': '290 L2',
 'year': 2021}
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-29 19:01:46 [auto1.nl] INFO: Saving data for UA80107: {'auction_closing_time': 1774884887.0, 'created_time': 1774699302.796768, 'last_price_update_time': 1774810906.945625}
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UA80107') HTTP/1.1" 204 0
2026-03-29 19:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:47 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-29 19:01:47 [auto1.nl] INFO: Scrape type for UH76205: 2
2026-03-29 19:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce34d86-5647-500b-9ed1-d7d90d905e87 with identifier: UH76205
2026-03-29 19:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce34d86-5647-500b-9ed1-d7d90d905e87 with scrape type 2
2026-03-29 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ce34d86-5647-500b-9ed1-d7d90d905e87 with scrape type 2
2026-03-29 19:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ce34d86-5647-500b-9ed1-d7d90d905e87, identifier: UH76205
2026-03-29 19:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ce34d86-5647-500b-9ed1-d7d90d905e87 with identifier: UH76205
2026-03-29 19:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ce34d86-5647-500b-9ed1-d7d90d905e87 with identifier: UH76205
2026-03-29 19:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ce34d86-5647-500b-9ed1-d7d90d905e87 with identifier: UH76205 to the API
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:06:23Z',
 'fuel_type': 'diesel',
 'id': '7ce34d86-5647-500b-9ed1-d7d90d905e87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH76205',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 231745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-26',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L2H1 2,9t Komfort',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Komfort',
 'year': 2018}
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-29 19:01:47 [auto1.nl] INFO: Saving data for UH76205: {'auction_closing_time': 1774883183.0, 'created_time': 1774699305.928081, 'last_price_update_time': 1774810907.442009}
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UH76205') HTTP/1.1" 204 0
2026-03-29 19:01:47 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-29 19:01:47 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-29 19:01:47 [auto1.nl] INFO: Scrape type for KX92525: 2
2026-03-29 19:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with identifier: KX92525
2026-03-29 19:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with scrape type 2
2026-03-29 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with scrape type 2
2026-03-29 19:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d58f8112-962c-547b-8d9b-c2cd8e90d9e3, identifier: KX92525
2026-03-29 19:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with identifier: KX92525
2026-03-29 19:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with identifier: KX92525
2026-03-29 19:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d58f8112-962c-547b-8d9b-c2cd8e90d9e3 with identifier: KX92525 to the API
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'diesel',
 'id': 'd58f8112-962c-547b-8d9b-c2cd8e90d9e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX92525',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 228744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI Kompakt',
 'transmission': 'automatic',
 'trim': 'Kompakt',
 'year': 2019}
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-29 19:01:47 [auto1.nl] INFO: Saving data for KX92525: {'auction_closing_time': 1774885637.0, 'created_time': 1774699300.307302, 'last_price_update_time': 1774810907.849315}
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX92525') HTTP/1.1" 204 0
2026-03-29 19:01:47 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-29 19:01:47 [auto1.nl] INFO: Scrape type for UU92994: 2
2026-03-29 19:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca1b2cc0-ad5b-5931-a174-f938dd042c6f with identifier: UU92994
2026-03-29 19:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f with scrape type 2
2026-03-29 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca1b2cc0-ad5b-5931-a174-f938dd042c6f with scrape type 2
2026-03-29 19:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca1b2cc0-ad5b-5931-a174-f938dd042c6f, identifier: UU92994
2026-03-29 19:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca1b2cc0-ad5b-5931-a174-f938dd042c6f with identifier: UU92994
2026-03-29 19:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca1b2cc0-ad5b-5931-a174-f938dd042c6f with identifier: UU92994
2026-03-29 19:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca1b2cc0-ad5b-5931-a174-f938dd042c6f with identifier: UU92994 to the API
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:16:03Z',
 'fuel_type': 'petrol',
 'id': 'ca1b2cc0-ad5b-5931-a174-f938dd042c6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU92994',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 231486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Kombi BlueMotion',
 'transmission': 'manual',
 'trim': 'Kombi BlueMotion',
 'year': 2020}
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-29 19:01:48 [auto1.nl] INFO: Saving data for UU92994: {'auction_closing_time': 1774883763.0, 'created_time': 1774699299.758286, 'last_price_update_time': 1774810908.223242}
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UU92994') HTTP/1.1" 204 0
2026-03-29 19:01:48 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-29 19:01:48 [auto1.nl] INFO: Scrape type for WY17438: 2
2026-03-29 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c2a98f-817f-50d9-9776-aee4fe773a4f with identifier: WY17438
2026-03-29 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c2a98f-817f-50d9-9776-aee4fe773a4f with scrape type 2
2026-03-29 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c2a98f-817f-50d9-9776-aee4fe773a4f with scrape type 2
2026-03-29 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20c2a98f-817f-50d9-9776-aee4fe773a4f, identifier: WY17438
2026-03-29 19:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20c2a98f-817f-50d9-9776-aee4fe773a4f with identifier: WY17438
2026-03-29 19:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20c2a98f-817f-50d9-9776-aee4fe773a4f with identifier: WY17438
2026-03-29 19:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20c2a98f-817f-50d9-9776-aee4fe773a4f with identifier: WY17438 to the API
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:39:28Z',
 'fuel_type': 'electro',
 'id': '20c2a98f-817f-50d9-9776-aee4fe773a4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY17438',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 104972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-26',
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2019}
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-29 19:01:48 [auto1.nl] INFO: Saving data for WY17438: {'auction_closing_time': 1774885168.0, 'created_time': 1774699301.03583, 'last_price_update_time': 1774810908.590408}
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY17438') HTTP/1.1" 204 0
2026-03-29 19:01:48 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-29 19:01:48 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-29 19:01:48 [auto1.nl] INFO: Scrape type for ZS54708: 2
2026-03-29 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with identifier: ZS54708
2026-03-29 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with scrape type 2
2026-03-29 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with scrape type 2
2026-03-29 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f, identifier: ZS54708
2026-03-29 19:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with identifier: ZS54708
2026-03-29 19:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with identifier: ZS54708
2026-03-29 19:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f with identifier: ZS54708 to the API
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:46Z',
 'fuel_type': 'petrol',
 'id': '7dd105d0-d9b7-5e68-8c6a-9bd8e4cf6b2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS54708',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 167235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-13',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-29 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-29 19:01:49 [auto1.nl] INFO: Saving data for ZS54708: {'auction_closing_time': 1774885846.0, 'created_time': 1774699297.64572, 'last_price_update_time': 1774810909.021964}
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZS54708') HTTP/1.1" 204 0
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-29 19:01:49 [auto1.nl] INFO: Scrape type for BB32456: 2
2026-03-29 19:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977d1786-000a-57ea-a389-213e0bc4dc9f with identifier: BB32456
2026-03-29 19:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977d1786-000a-57ea-a389-213e0bc4dc9f with scrape type 2
2026-03-29 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 977d1786-000a-57ea-a389-213e0bc4dc9f with scrape type 2
2026-03-29 19:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 977d1786-000a-57ea-a389-213e0bc4dc9f, identifier: BB32456
2026-03-29 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 977d1786-000a-57ea-a389-213e0bc4dc9f with identifier: BB32456
2026-03-29 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 977d1786-000a-57ea-a389-213e0bc4dc9f with identifier: BB32456
2026-03-29 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 977d1786-000a-57ea-a389-213e0bc4dc9f with identifier: BB32456 to the API
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:00:50Z',
 'fuel_type': 'petrol',
 'id': '977d1786-000a-57ea-a389-213e0bc4dc9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB32456',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 212777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-29 19:01:49 [auto1.nl] INFO: Saving data for BB32456: {'auction_closing_time': 1774882850.0, 'created_time': 1774699305.376124, 'last_price_update_time': 1774810909.457955}
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BB32456') HTTP/1.1" 204 0
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-29 19:01:49 [auto1.nl] INFO: Scrape type for WW25859: 2
2026-03-29 19:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52ed755c-0c67-5275-b6c1-398420ac03ee with identifier: WW25859
2026-03-29 19:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ed755c-0c67-5275-b6c1-398420ac03ee with scrape type 2
2026-03-29 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52ed755c-0c67-5275-b6c1-398420ac03ee with scrape type 2
2026-03-29 19:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 52ed755c-0c67-5275-b6c1-398420ac03ee, identifier: WW25859
2026-03-29 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 52ed755c-0c67-5275-b6c1-398420ac03ee with identifier: WW25859
2026-03-29 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 52ed755c-0c67-5275-b6c1-398420ac03ee with identifier: WW25859
2026-03-29 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 52ed755c-0c67-5275-b6c1-398420ac03ee with identifier: WW25859 to the API
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:14:39Z',
 'fuel_type': 'petrol',
 'id': '52ed755c-0c67-5275-b6c1-398420ac03ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW25859',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 116526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-03-02',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Viva',
 'transmission': 'manual',
 'trim': 'Viva',
 'year': 2000}
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-29 19:01:49 [auto1.nl] INFO: Saving data for WW25859: {'auction_closing_time': 1774883679.0, 'created_time': 1774699294.793767, 'last_price_update_time': 1774810909.840491}
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WW25859') HTTP/1.1" 204 0
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-29 19:01:49 [auto1.nl] INFO: Scrape type for BP52845: 0
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-29 19:01:49 [auto1.nl] INFO: Scrape type for DX51815: 0
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-29 19:01:49 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for NJ12224: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for DJ46393: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for JF84007: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for KD48941: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for WN94746: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for EU38085: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for WU56616: 0
2026-03-29 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:50 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 758 | hits on page: 38
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for CT48510: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for RD76922: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for WC26387: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for LF00808: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for JM92964: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for HJ37238: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for JK34334: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for YB88576: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for YG37971: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for UF88780: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for KC88699: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for WZ79997: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for MP39959: 2
2026-03-29 19:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e44968-0238-5bb8-a93d-151689ed6907 with identifier: MP39959
2026-03-29 19:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e44968-0238-5bb8-a93d-151689ed6907 with scrape type 2
2026-03-29 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97e44968-0238-5bb8-a93d-151689ed6907 with scrape type 2
2026-03-29 19:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 97e44968-0238-5bb8-a93d-151689ed6907, identifier: MP39959
2026-03-29 19:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 97e44968-0238-5bb8-a93d-151689ed6907 with identifier: MP39959
2026-03-29 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 97e44968-0238-5bb8-a93d-151689ed6907 with identifier: MP39959
2026-03-29 19:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 97e44968-0238-5bb8-a93d-151689ed6907 with identifier: MP39959 to the API
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:58:36Z',
 'fuel_type': 'petrol',
 'id': '97e44968-0238-5bb8-a93d-151689ed6907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP39959',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pixo',
 'odometer': 170709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-16',
 'seller_name': None,
 'title': 'Nissan Pixo 1.0 Fun/Look',
 'transmission': 'manual',
 'trim': 'Fun/Look',
 'year': 2012}
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Saving data for MP39959: {'auction_closing_time': 1774886316.0, 'created_time': 1774699307.441191, 'last_price_update_time': 1774810910.826264}
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP39959') HTTP/1.1" 204 0
2026-03-29 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for YN95467: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-29 19:01:50 [auto1.nl] INFO: Scrape type for AW17903: 0
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-29 19:01:50 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-29 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-29 19:01:51 [auto1.nl] INFO: Scrape type for NC22018: 0
2026-03-29 19:01:51 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-29 19:01:51 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-29 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-29 19:01:51 [auto1.nl] INFO: Scrape type for ZG49112: 0
2026-03-29 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:01:51 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 758 | hits on page: 0
2026-03-29 19:01:51 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 19:01:51 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-29 19:01:51 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 4, <ScrapeType.BATCH_SKIPPED: 5>: 4}
2026-03-29 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774378911 HTTP/1.1" 200 None
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AL09883') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AS47149') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AT51508') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BE96014') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BS69693') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BT69030') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU75521') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA47233') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA95508') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ71522') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CK05363') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CK20661') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM36869') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP57212') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CV48505') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DB55052') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DD06242') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DD99999') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF99309') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ03064') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ58295') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU06840') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB29965') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB63709') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EC74612') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG11732') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ18415') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ42585') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EL40997') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EW30362') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB87464') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE46330') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH62195') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ41120') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FL28510') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FS94964') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA35283') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GB19267') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GB33242') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD06739') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GE92727') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN93265') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV37428') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HA33141') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HG83749') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH81542') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK51632') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW65119') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK44019') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JV75666') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JV88732') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB90972') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KM57096') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KR38619') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KS48724') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KW79723') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX54954') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LC95160') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH26195') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH62729') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LL43950') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT99069') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX60811') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MF57745') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MH04118') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MM22251') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MR30378') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NC99143') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL07359') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX51399') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ82309') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA23871') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PC79268') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PD16195') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PD20198') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PK56740') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS06381') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RE51515') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF42797') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RJ44954') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY17216') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD97016') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SF22403') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SF73454') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SJ39065') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SS07864') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA99477') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC63225') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC85700') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TK02952') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC93613') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF52180') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UK87540') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UL77882') HTTP/1.1" 204 0
2026-03-29 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UN65044') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UV46581') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UW64379') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VF94188') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH18878') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VJ40103') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VK14339') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VN60794') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VY69706') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VY95061') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WR49821') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WV10286') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XD35165') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XE04003') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XE99760') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XF81391') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XH53048') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XM14470') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XS62639') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XT93618') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB23570') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YM05268') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZC00235') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZN70374') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZN80037') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR70834') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR81683') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZS79391') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZT04564') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZV02954') HTTP/1.1" 204 0
2026-03-29 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZV80842') HTTP/1.1" 204 0
2026-03-29 19:01:53 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (155 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-29T19_00_00.jl
2026-03-29 19:01:53 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 64180,
 'downloader/request_count': 24,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 22,
 'downloader/response_bytes': 3430041,
 'downloader/response_count': 24,
 'downloader/response_status_count/200': 24,
 'elapsed_time_seconds': 106.415814,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 19, 1, 53, 332369, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 155,
 'log_count/DEBUG': 2105,
 'log_count/INFO': 2516,
 'memusage/max': 164810752,
 'memusage/startup': 149966848,
 'request_depth_max': 23,
 'response_received_count': 24,
 'scheduler/dequeued': 24,
 'scheduler/dequeued/memory': 24,
 'scheduler/enqueued': 24,
 'scheduler/enqueued/memory': 24,
 'scrape_type/batch_skipped': 396,
 'scrape_type/price_update': 155,
 'scrape_type/skipped': 247,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 24,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.009985691130472,
 'scrapy-zyte-api/mean_response_seconds': 3.067780989164021,
 'scrapy-zyte-api/processed': 24,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 24,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 23,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 24,
 'scrapy-zyte-api/request_args/httpRequestBody': 22,
 'scrapy-zyte-api/request_args/httpRequestMethod': 22,
 'scrapy-zyte-api/request_args/httpResponseBody': 24,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 24,
 'scrapy-zyte-api/request_args/sessionContext': 24,
 'scrapy-zyte-api/request_args/url': 24,
 'scrapy-zyte-api/status_codes/200': 24,
 'scrapy-zyte-api/success': 24,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 798,
 'source/total_available': 758,
 'start_time': datetime.datetime(2026, 3, 29, 19, 0, 6, 916555, tzinfo=datetime.timezone.utc)}
2026-03-29 19:01:53 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 19:01:53 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f556e6122d0>
2026-03-29 19:01:53 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f556e764410>