2026-03-29 19:10:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 19:10:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 19:10:06 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-29 19:10:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-29 19:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 19:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 19:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 19:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 19:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: 1efbdcf75f8366aa
2026-03-29 19:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 19:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-29T19_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 19:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 19:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 19:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 19:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 19:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 19:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 19:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-29 19:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 19:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 19:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 19:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 19:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 19:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 19:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 19:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 19:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 19:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 19:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 19:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 19:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 19:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 19:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 19:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 19:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 19:10:15 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for XW90615: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for KJ03037: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for YC94295: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for PE07058: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW98362%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for BW98362: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for ZP63684: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for VL80205: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for FD56899: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for FJ96412: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF19474%27 HTTP/1.1" 200 None
2026-03-29 19:10:15 [auto1.nl] INFO: Scrape type for YF19474: 0
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-29 19:10:15 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-29 19:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-29 19:10:16 [auto1.nl] INFO: Scrape type for CN90357: 0
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-29 19:10:16 [auto1.nl] INFO: Scrape type for JG60699: 0
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-29 19:10:16 [auto1.nl] INFO: Scrape type for ZJ02157: 0
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-29 19:10:16 [auto1.nl] INFO: Scrape type for GX78126: 0
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-29 19:10:16 [auto1.nl] INFO: Scrape type for ME06294: 0
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN80164%27 HTTP/1.1" 200 None
2026-03-29 19:10:16 [auto1.nl] INFO: Scrape type for NN80164: 0
2026-03-29 19:10:16 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-29 19:10:16 [auto1.nl] INFO: Scrape type for AW61305: 0
2026-03-29 19:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:17 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for XW90615: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for KJ03037: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for YC94295: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for PE07058: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW98362%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for BW98362: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for ZP63684: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for VL80205: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for FD56899: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for FJ96412: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF19474%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for YF19474: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for CN90357: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for JG60699: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for ZJ02157: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for GX78126: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for ME06294: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN80164%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for NN80164: 0
2026-03-29 19:10:17 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-29 19:10:17 [auto1.nl] INFO: Scrape type for AW61305: 0
2026-03-29 19:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:18 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX02211%27 HTTP/1.1" 200 None
2026-03-29 19:10:18 [auto1.nl] INFO: Scrape type for LX02211: 0
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY24262%27 HTTP/1.1" 200 None
2026-03-29 19:10:18 [auto1.nl] INFO: Scrape type for PY24262: 0
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB25892%27 HTTP/1.1" 200 None
2026-03-29 19:10:18 [auto1.nl] INFO: Scrape type for YB25892: 0
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW76665%27 HTTP/1.1" 200 None
2026-03-29 19:10:18 [auto1.nl] INFO: Scrape type for DW76665: 0
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-29 19:10:18 [auto1.nl] INFO: Scrape type for JW20864: 0
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-29 19:10:18 [auto1.nl] INFO: Scrape type for JZ35389: 0
2026-03-29 19:10:18 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK38734%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for RK38734: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG10005%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for KG10005: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA59748%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for NA59748: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for NT73578: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW17095%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for XW17095: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MG34346%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for MG34346: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for ZE21436: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY98170%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for NY98170: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV60983%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for YV60983: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for GK27630: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC52581%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for TC52581: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC17693%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for GC17693: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME46694%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for ME46694: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD44164%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for YD44164: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX76007%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for EX76007: 0
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-29 19:10:19 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SU37312%27 HTTP/1.1" 200 None
2026-03-29 19:10:19 [auto1.nl] INFO: Scrape type for SU37312: 0
2026-03-29 19:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:20 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-29 19:10:20 [auto1.nl] INFO: Scrape type for SS31744: 0
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-29 19:10:20 [auto1.nl] INFO: Scrape type for GY89787: 0
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-29 19:10:20 [auto1.nl] INFO: Scrape type for VL52985: 0
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA77037%27 HTTP/1.1" 200 None
2026-03-29 19:10:20 [auto1.nl] INFO: Scrape type for CA77037: 0
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC51093%27 HTTP/1.1" 200 None
2026-03-29 19:10:20 [auto1.nl] INFO: Scrape type for MC51093: 0
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-29 19:10:20 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-29 19:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for ZL38920: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ31943%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for SZ31943: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for TU57635: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH35225%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for RH35225: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX09180%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for CX09180: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ14164%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for BZ14164: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for GD44915: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC01356%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for AC01356: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for JL68792: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP11309%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for VP11309: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for ZY88945: 0
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-29 19:10:21 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-29 19:10:21 [auto1.nl] INFO: Scrape type for KX21734: 2
2026-03-29 19:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with identifier: KX21734
2026-03-29 19:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with scrape type 2
2026-03-29 19:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with scrape type 2
2026-03-29 19:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 54c64ac4-0b5e-5729-9514-4ba54cee93d5, identifier: KX21734
2026-03-29 19:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with identifier: KX21734
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 19:10:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 19:10:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with identifier: KX21734
2026-03-29 19:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 54c64ac4-0b5e-5729-9514-4ba54cee93d5 with identifier: KX21734 to the API
2026-03-29 19:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:18:09Z',
 'fuel_type': 'petrol',
 'id': '54c64ac4-0b5e-5729-9514-4ba54cee93d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX21734',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 193391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-04-28',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 230 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 1997}
2026-03-29 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-29 19:10:22 [auto1.nl] INFO: Saving data for KX21734: {'auction_closing_time': 1774883889.0, 'created_time': 1773836844.423176, 'last_price_update_time': 1774811422.697498}
2026-03-29 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX21734') HTTP/1.1" 204 0
2026-03-29 19:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:22 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-29 19:10:22 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-29 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR57884%27 HTTP/1.1" 200 None
2026-03-29 19:10:22 [auto1.nl] INFO: Scrape type for HR57884: 0
2026-03-29 19:10:22 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-29 19:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:23 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:23 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-29 19:10:23 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-29 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ99279%27 HTTP/1.1" 200 None
2026-03-29 19:10:23 [auto1.nl] INFO: Scrape type for DJ99279: 2
2026-03-29 19:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with identifier: DJ99279
2026-03-29 19:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with scrape type 2
2026-03-29 19:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with scrape type 2
2026-03-29 19:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b, identifier: DJ99279
2026-03-29 19:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with identifier: DJ99279
2026-03-29 19:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 19:10:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 19:10:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with identifier: DJ99279
2026-03-29 19:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78d6dc56-16a0-5e33-b4db-6c848c1a6a2b with identifier: DJ99279 to the API
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:53:09Z',
 'fuel_type': 'diesel',
 'id': '78d6dc56-16a0-5e33-b4db-6c848c1a6a2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ99279',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 262161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ99279%27 HTTP/1.1" 200 None
2026-03-29 19:10:24 [auto1.nl] INFO: Saving data for DJ99279: {'auction_closing_time': 1774885989.0, 'created_time': 1774033996.836276, 'last_price_update_time': 1774811424.505521}
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ99279') HTTP/1.1" 204 0
2026-03-29 19:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:24 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20154%27 HTTP/1.1" 200 None
2026-03-29 19:10:24 [auto1.nl] INFO: Scrape type for LZ20154: 2
2026-03-29 19:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433a8b0d-6789-5e38-a80d-9168a57a85f3 with identifier: LZ20154
2026-03-29 19:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433a8b0d-6789-5e38-a80d-9168a57a85f3 with scrape type 2
2026-03-29 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 433a8b0d-6789-5e38-a80d-9168a57a85f3 with scrape type 2
2026-03-29 19:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 433a8b0d-6789-5e38-a80d-9168a57a85f3, identifier: LZ20154
2026-03-29 19:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 433a8b0d-6789-5e38-a80d-9168a57a85f3 with identifier: LZ20154
2026-03-29 19:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 433a8b0d-6789-5e38-a80d-9168a57a85f3 with identifier: LZ20154
2026-03-29 19:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 433a8b0d-6789-5e38-a80d-9168a57a85f3 with identifier: LZ20154 to the API
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:29:19Z',
 'fuel_type': 'petrol',
 'id': '433a8b0d-6789-5e38-a80d-9168a57a85f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ20154',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka+',
 'odometer': 34201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-15',
 'seller_name': None,
 'title': 'Ford Ka+ 1.2 Ti-VCT Cool&Sound',
 'transmission': 'manual',
 'trim': 'Cool&Sound',
 'year': 2017}
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20154%27 HTTP/1.1" 200 None
2026-03-29 19:10:24 [auto1.nl] INFO: Saving data for LZ20154: {'auction_closing_time': 1774884559.0, 'created_time': 1774034009.978285, 'last_price_update_time': 1774811424.894676}
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LZ20154') HTTP/1.1" 204 0
2026-03-29 19:10:24 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-29 19:10:24 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW21106%27 HTTP/1.1" 200 None
2026-03-29 19:10:24 [auto1.nl] INFO: Scrape type for GW21106: 2
2026-03-29 19:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf9f42f0-ebaa-5658-a04b-199441647e09 with identifier: GW21106
2026-03-29 19:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf9f42f0-ebaa-5658-a04b-199441647e09 with scrape type 2
2026-03-29 19:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf9f42f0-ebaa-5658-a04b-199441647e09 with scrape type 2
2026-03-29 19:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cf9f42f0-ebaa-5658-a04b-199441647e09, identifier: GW21106
2026-03-29 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cf9f42f0-ebaa-5658-a04b-199441647e09 with identifier: GW21106
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cf9f42f0-ebaa-5658-a04b-199441647e09 with identifier: GW21106
2026-03-29 19:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cf9f42f0-ebaa-5658-a04b-199441647e09 with identifier: GW21106 to the API
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'petrol',
 'id': 'cf9f42f0-ebaa-5658-a04b-199441647e09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW21106',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 334483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-29',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW21106%27 HTTP/1.1" 200 None
2026-03-29 19:10:25 [auto1.nl] INFO: Saving data for GW21106: {'auction_closing_time': 1774883687.0, 'created_time': 1774725022.955894, 'last_price_update_time': 1774811425.408847}
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW21106') HTTP/1.1" 204 0
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV89778%27 HTTP/1.1" 200 None
2026-03-29 19:10:25 [auto1.nl] INFO: Scrape type for VV89778: 2
2026-03-29 19:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with identifier: VV89778
2026-03-29 19:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with scrape type 2
2026-03-29 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with scrape type 2
2026-03-29 19:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc, identifier: VV89778
2026-03-29 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with identifier: VV89778
2026-03-29 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with identifier: VV89778
2026-03-29 19:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc with identifier: VV89778 to the API
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:19Z',
 'fuel_type': 'petrol',
 'id': '9d9d5247-a707-5d4e-bb16-c1ce6a4ae7bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV89778',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 208738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-24',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV89778%27 HTTP/1.1" 200 None
2026-03-29 19:10:25 [auto1.nl] INFO: Saving data for VV89778: {'auction_closing_time': 1774886239.0, 'created_time': 1774725025.426583, 'last_price_update_time': 1774811425.812696}
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VV89778') HTTP/1.1" 204 0
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ29701%27 HTTP/1.1" 200 None
2026-03-29 19:10:25 [auto1.nl] INFO: Scrape type for XZ29701: 0
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UM83404%27 HTTP/1.1" 200 None
2026-03-29 19:10:25 [auto1.nl] INFO: Scrape type for UM83404: 0
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-29 19:10:25 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-29 19:10:25 [auto1.nl] INFO: Scrape type for GN29290: 2
2026-03-29 19:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-29 19:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20d870f5-f553-571d-9e90-79e301fa3cd6 with scrape type 2
2026-03-29 19:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20d870f5-f553-571d-9e90-79e301fa3cd6 with scrape type 2
2026-03-29 19:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20d870f5-f553-571d-9e90-79e301fa3cd6, identifier: GN29290
2026-03-29 19:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-29 19:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-29 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290 to the API
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:20:05Z',
 'fuel_type': 'petrol',
 'id': '20d870f5-f553-571d-9e90-79e301fa3cd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN29290',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 151554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-13',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2007}
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-29 19:10:26 [auto1.nl] INFO: Saving data for GN29290: {'auction_closing_time': 1774884005.0, 'created_time': 1774613481.217498, 'last_price_update_time': 1774811426.310184}
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN29290') HTTP/1.1" 204 0
2026-03-29 19:10:26 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-29 19:10:26 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-29 19:10:26 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-29 19:10:26 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-29 19:10:26 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-29 19:10:26 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-29 19:10:26 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-29 19:10:26 [auto1.nl] INFO: Scrape type for NV18219: 2
2026-03-29 19:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-29 19:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c29d93-16a6-508a-9123-64321ec59c9a with scrape type 2
2026-03-29 19:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2c29d93-16a6-508a-9123-64321ec59c9a with scrape type 2
2026-03-29 19:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2c29d93-16a6-508a-9123-64321ec59c9a, identifier: NV18219
2026-03-29 19:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 19:10:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-29 19:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219 to the API
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:25:33Z',
 'fuel_type': 'petrol',
 'id': 'f2c29d93-16a6-508a-9123-64321ec59c9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV18219',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 220479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-26',
 'seller_name': None,
 'title': 'BMW X3 3.0i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-29 19:10:27 [auto1.nl] INFO: Saving data for NV18219: {'auction_closing_time': 1774884333.0, 'created_time': 1774613443.547074, 'last_price_update_time': 1774811427.092575}
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NV18219') HTTP/1.1" 204 0
2026-03-29 19:10:27 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-29 19:10:27 [auto1.nl] INFO: Scrape type for SA79399: 0
2026-03-29 19:10:27 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-29 19:10:27 [auto1.nl] INFO: Scrape type for MR73967: 2
2026-03-29 19:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-29 19:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2cbb42c-8faf-56ac-900a-7beba7154dac with scrape type 2
2026-03-29 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2cbb42c-8faf-56ac-900a-7beba7154dac with scrape type 2
2026-03-29 19:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2cbb42c-8faf-56ac-900a-7beba7154dac, identifier: MR73967
2026-03-29 19:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-29 19:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-29 19:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967 to the API
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:59Z',
 'fuel_type': 'diesel',
 'id': 'd2cbb42c-8faf-56ac-900a-7beba7154dac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR73967',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 272668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat Edition 4Motion BlueMotion',
 'year': 2016}
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-29 19:10:27 [auto1.nl] INFO: Saving data for MR73967: {'auction_closing_time': 1774883699.0, 'created_time': 1774527045.893859, 'last_price_update_time': 1774811427.579553}
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MR73967') HTTP/1.1" 204 0
2026-03-29 19:10:27 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-29 19:10:27 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-29 19:10:27 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-29 19:10:27 [auto1.nl] INFO: Scrape type for FZ85660: 0
2026-03-29 19:10:27 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-29 19:10:27 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-29 19:10:27 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-29 19:10:27 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-29 19:10:27 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-29 19:10:27 [auto1.nl] INFO: Scrape type for JG46150: 2
2026-03-29 19:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-29 19:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9877e3e3-9d23-5e32-80a3-17af76d5c40c with scrape type 2
2026-03-29 19:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9877e3e3-9d23-5e32-80a3-17af76d5c40c with scrape type 2
2026-03-29 19:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9877e3e3-9d23-5e32-80a3-17af76d5c40c, identifier: JG46150
2026-03-29 19:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 19:10:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-29 19:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150 to the API
2026-03-29 19:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:38:47Z',
 'fuel_type': 'diesel',
 'id': '9877e3e3-9d23-5e32-80a3-17af76d5c40c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG46150',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 321308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-04',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-29 19:10:29 [auto1.nl] INFO: Saving data for JG46150: {'auction_closing_time': 1774885127.0, 'created_time': 1774008646.275382, 'last_price_update_time': 1774811429.14363}
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG46150') HTTP/1.1" 204 0
2026-03-29 19:10:29 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-29 19:10:29 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-29 19:10:29 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-29 19:10:29 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-29 19:10:29 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-29 19:10:29 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-29 19:10:29 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-29 19:10:29 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-29 19:10:29 [auto1.nl] INFO: Scrape type for FR61201: 2
2026-03-29 19:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-29 19:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c28401-a63c-572a-a6f8-20b7567a2d9c with scrape type 2
2026-03-29 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89c28401-a63c-572a-a6f8-20b7567a2d9c with scrape type 2
2026-03-29 19:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 89c28401-a63c-572a-a6f8-20b7567a2d9c, identifier: FR61201
2026-03-29 19:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-29 19:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-29 19:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201 to the API
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:02:56Z',
 'fuel_type': 'petrol',
 'id': '89c28401-a63c-572a-a6f8-20b7567a2d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR61201',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 145022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-13',
 'seller_name': None,
 'title': 'BMW 6er 630i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-29 19:10:29 [auto1.nl] INFO: Saving data for FR61201: {'auction_closing_time': 1774882976.0, 'created_time': 1773302367.371782, 'last_price_update_time': 1774811429.701277}
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR61201') HTTP/1.1" 204 0
2026-03-29 19:10:29 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-29 19:10:29 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-29 19:10:29 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-29 19:10:29 [auto1.nl] INFO: Scrape type for SV00912: 2
2026-03-29 19:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-29 19:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7102d58d-8e12-51ba-90bf-5b632bc53acf with scrape type 2
2026-03-29 19:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7102d58d-8e12-51ba-90bf-5b632bc53acf with scrape type 2
2026-03-29 19:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7102d58d-8e12-51ba-90bf-5b632bc53acf, identifier: SV00912
2026-03-29 19:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-29 19:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-29 19:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912 to the API
2026-03-29 19:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:57:03Z',
 'fuel_type': 'petrol',
 'id': '7102d58d-8e12-51ba-90bf-5b632bc53acf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV00912',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 251869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-29 19:10:30 [auto1.nl] INFO: Saving data for SV00912: {'auction_closing_time': 1774886223.0, 'created_time': 1774293144.132, 'last_price_update_time': 1774811430.123748}
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV00912') HTTP/1.1" 204 0
2026-03-29 19:10:30 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-29 19:10:30 [auto1.nl] INFO: Scrape type for JN77730: 2
2026-03-29 19:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-29 19:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with scrape type 2
2026-03-29 19:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with scrape type 2
2026-03-29 19:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5, identifier: JN77730
2026-03-29 19:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-29 19:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-29 19:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730 to the API
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:20:44Z',
 'fuel_type': 'petrol',
 'id': 'a11c3c1f-aac5-54eb-a602-5c6217d1cbb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN77730',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 228593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-29 19:10:30 [auto1.nl] INFO: Saving data for JN77730: {'auction_closing_time': 1774884044.0, 'created_time': 1773749674.371386, 'last_price_update_time': 1774811430.54934}
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JN77730') HTTP/1.1" 204 0
2026-03-29 19:10:30 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:30 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-29 19:10:30 [auto1.nl] INFO: Scrape type for AX06352: 2
2026-03-29 19:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-29 19:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3457c2fc-3ceb-56de-821f-c366bb033387 with scrape type 2
2026-03-29 19:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3457c2fc-3ceb-56de-821f-c366bb033387 with scrape type 2
2026-03-29 19:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3457c2fc-3ceb-56de-821f-c366bb033387, identifier: AX06352
2026-03-29 19:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-29 19:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-29 19:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352 to the API
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:38Z',
 'fuel_type': 'diesel',
 'id': '3457c2fc-3ceb-56de-821f-c366bb033387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX06352',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 222877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-03',
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Kasten Comfort',
 'transmission': 'manual',
 'trim': 'Kasten Comfort',
 'year': 2011}
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-29 19:10:30 [auto1.nl] INFO: Saving data for AX06352: {'auction_closing_time': 1774883678.0, 'created_time': 1774268081.306856, 'last_price_update_time': 1774811430.96965}
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX06352') HTTP/1.1" 204 0
2026-03-29 19:10:30 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-29 19:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for VU12203: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD02824%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for XD02824: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for AA80905: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for TB82163: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for SY92282: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for AX28541: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for DD48612: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for MM08239: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for NR59954: 2
2026-03-29 19:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-29 19:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a57a418-7494-5caa-99bb-22f2e88a16d7 with scrape type 2
2026-03-29 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a57a418-7494-5caa-99bb-22f2e88a16d7 with scrape type 2
2026-03-29 19:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a57a418-7494-5caa-99bb-22f2e88a16d7, identifier: NR59954
2026-03-29 19:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:31 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Scrape type for YT76844: 2
2026-03-29 19:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-29 19:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf5ea50-607b-5503-ae3d-b3e4e21cde23 with scrape type 2
2026-03-29 19:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf5ea50-607b-5503-ae3d-b3e4e21cde23 with scrape type 2
2026-03-29 19:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: daf5ea50-607b-5503-ae3d-b3e4e21cde23, identifier: YT76844
2026-03-29 19:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-29 19:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-29 19:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954 to the API
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:55:21Z',
 'fuel_type': 'petrol',
 'id': '8a57a418-7494-5caa-99bb-22f2e88a16d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR59954',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 319215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'Volvo V70 1.6 T4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2012}
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-29 19:10:31 [auto1.nl] INFO: Saving data for NR59954: {'auction_closing_time': 1774886121.0, 'created_time': 1773232326.378528, 'last_price_update_time': 1774811431.774814}
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR59954') HTTP/1.1" 204 0
2026-03-29 19:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-29 19:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-29 19:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844 to the API
2026-03-29 19:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:39:50Z',
 'fuel_type': 'petrol',
 'id': 'daf5ea50-607b-5503-ae3d-b3e4e21cde23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT76844',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 140074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-29 19:10:32 [auto1.nl] INFO: Saving data for YT76844: {'auction_closing_time': 1774885190.0, 'created_time': 1774293126.048266, 'last_price_update_time': 1774811432.183063}
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT76844') HTTP/1.1" 204 0
2026-03-29 19:10:32 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-29 19:10:32 [auto1.nl] INFO: Scrape type for LC20908: 0
2026-03-29 19:10:32 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-29 19:10:32 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-29 19:10:32 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-29 19:10:32 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-29 19:10:32 [auto1.nl] INFO: Scrape type for KB59261: 2
2026-03-29 19:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-29 19:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with scrape type 2
2026-03-29 19:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with scrape type 2
2026-03-29 19:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34f5884b-19d6-5769-8ee9-afca53ae5eb6, identifier: KB59261
2026-03-29 19:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-29 19:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-29 19:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261 to the API
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:37:55Z',
 'fuel_type': 'petrol',
 'id': '34f5884b-19d6-5769-8ee9-afca53ae5eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB59261',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 139006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-29 19:10:32 [auto1.nl] INFO: Saving data for KB59261: {'auction_closing_time': 1774885075.0, 'created_time': 1774527030.607707, 'last_price_update_time': 1774811432.586454}
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB59261') HTTP/1.1" 204 0
2026-03-29 19:10:32 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-29 19:10:32 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-29 19:10:32 [auto1.nl] INFO: Scrape type for NX76865: 0
2026-03-29 19:10:32 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-29 19:10:32 [auto1.nl] INFO: Scrape type for MD55137: 2
2026-03-29 19:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-29 19:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a92613-fb03-5e07-94a5-f24ca2302e7e with scrape type 2
2026-03-29 19:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a92613-fb03-5e07-94a5-f24ca2302e7e with scrape type 2
2026-03-29 19:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2a92613-fb03-5e07-94a5-f24ca2302e7e, identifier: MD55137
2026-03-29 19:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-29 19:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-29 19:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137 to the API
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'petrol',
 'id': 'd2a92613-fb03-5e07-94a5-f24ca2302e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD55137',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 103056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'BMW X2 sDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-29 19:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-29 19:10:33 [auto1.nl] INFO: Saving data for MD55137: {'auction_closing_time': 1774886205.0, 'created_time': 1774527090.69407, 'last_price_update_time': 1774811433.0092}
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD55137') HTTP/1.1" 204 0
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-29 19:10:33 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-29 19:10:33 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-29 19:10:33 [auto1.nl] INFO: Scrape type for SY10793: 2
2026-03-29 19:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-29 19:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69eeae17-cb4c-5500-8736-e5d694b982b9 with scrape type 2
2026-03-29 19:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69eeae17-cb4c-5500-8736-e5d694b982b9 with scrape type 2
2026-03-29 19:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69eeae17-cb4c-5500-8736-e5d694b982b9, identifier: SY10793
2026-03-29 19:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-29 19:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-29 19:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793 to the API
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:13Z',
 'fuel_type': 'petrol',
 'id': '69eeae17-cb4c-5500-8736-e5d694b982b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY10793',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 197754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-29 19:10:33 [auto1.nl] INFO: Saving data for SY10793: {'auction_closing_time': 1774885633.0, 'created_time': 1774613482.730974, 'last_price_update_time': 1774811433.463003}
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY10793') HTTP/1.1" 204 0
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-29 19:10:33 [auto1.nl] INFO: Scrape type for MZ48021: 0
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-29 19:10:33 [auto1.nl] INFO: Scrape type for DS36560: 0
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-29 19:10:33 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-29 19:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:35 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-29 19:10:35 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-29 19:10:35 [auto1.nl] INFO: Scrape type for RC74760: 2
2026-03-29 19:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-29 19:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6075b79-10fa-5ce8-a74f-84de841b9f57 with scrape type 2
2026-03-29 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6075b79-10fa-5ce8-a74f-84de841b9f57 with scrape type 2
2026-03-29 19:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6075b79-10fa-5ce8-a74f-84de841b9f57, identifier: RC74760
2026-03-29 19:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-29 19:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-29 19:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760 to the API
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:57Z',
 'fuel_type': 'petrol',
 'id': 'e6075b79-10fa-5ce8-a74f-84de841b9f57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC74760',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 189093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-13',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-29 19:10:35 [auto1.nl] INFO: Saving data for RC74760: {'auction_closing_time': 1774882917.0, 'created_time': 1774613433.421632, 'last_price_update_time': 1774811435.639043}
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC74760') HTTP/1.1" 204 0
2026-03-29 19:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-29 19:10:35 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-29 19:10:35 [auto1.nl] INFO: Scrape type for VL07732: 2
2026-03-29 19:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-29 19:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f516a972-b818-568f-b830-99740ff1df52 with scrape type 2
2026-03-29 19:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f516a972-b818-568f-b830-99740ff1df52 with scrape type 2
2026-03-29 19:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f516a972-b818-568f-b830-99740ff1df52, identifier: VL07732
2026-03-29 19:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 19:10:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-29 19:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732 to the API
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:13:39Z',
 'fuel_type': 'petrol',
 'id': 'f516a972-b818-568f-b830-99740ff1df52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL07732',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 246337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-29 19:10:36 [auto1.nl] INFO: Saving data for VL07732: {'auction_closing_time': 1774883619.0, 'created_time': 1774527083.562605, 'last_price_update_time': 1774811436.282172}
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL07732') HTTP/1.1" 204 0
2026-03-29 19:10:36 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-29 19:10:36 [auto1.nl] INFO: Scrape type for RX80263: 0
2026-03-29 19:10:36 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-29 19:10:36 [auto1.nl] INFO: Scrape type for GL59810: 2
2026-03-29 19:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-29 19:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a61d4a81-1529-5666-b186-c114766bf705 with scrape type 2
2026-03-29 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a61d4a81-1529-5666-b186-c114766bf705 with scrape type 2
2026-03-29 19:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a61d4a81-1529-5666-b186-c114766bf705, identifier: GL59810
2026-03-29 19:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-29 19:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810
2026-03-29 19:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a61d4a81-1529-5666-b186-c114766bf705 with identifier: GL59810 to the API
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:47Z',
 'fuel_type': 'petrol',
 'id': 'a61d4a81-1529-5666-b186-c114766bf705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL59810',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 155938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-29 19:10:36 [auto1.nl] INFO: Saving data for GL59810: {'auction_closing_time': 1774883147.0, 'created_time': 1773924411.943258, 'last_price_update_time': 1774811436.685784}
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GL59810') HTTP/1.1" 204 0
2026-03-29 19:10:36 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-29 19:10:36 [auto1.nl] INFO: Scrape type for DG66253: 2
2026-03-29 19:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-29 19:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with scrape type 2
2026-03-29 19:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with scrape type 2
2026-03-29 19:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454, identifier: DG66253
2026-03-29 19:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-29 19:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-29 19:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253 to the API
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:02:10Z',
 'fuel_type': 'petrol',
 'id': '8e8a9c89-27ee-537c-b1cf-a226e6ae2454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG66253',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 178248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-19',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-29 19:10:37 [auto1.nl] INFO: Saving data for DG66253: {'auction_closing_time': 1774882930.0, 'created_time': 1774527055.729414, 'last_price_update_time': 1774811437.07285}
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DG66253') HTTP/1.1" 204 0
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-29 19:10:37 [auto1.nl] INFO: Scrape type for GD99184: 0
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-29 19:10:37 [auto1.nl] INFO: Scrape type for ZP12059: 0
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-29 19:10:37 [auto1.nl] INFO: Scrape type for ML63258: 0
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-29 19:10:37 [auto1.nl] INFO: Scrape type for RA23366: 0
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-29 19:10:37 [auto1.nl] INFO: Scrape type for NX47084: 2
2026-03-29 19:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-29 19:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with scrape type 2
2026-03-29 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with scrape type 2
2026-03-29 19:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4, identifier: NX47084
2026-03-29 19:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 19:10:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-29 19:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084 to the API
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:25:17Z',
 'fuel_type': 'hybrid',
 'id': 'a95d0e9f-f0c3-5ef4-ae63-03595406ccf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX47084',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 196479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-29 19:10:37 [auto1.nl] INFO: Saving data for NX47084: {'auction_closing_time': 1774884317.0, 'created_time': 1773134904.784466, 'last_price_update_time': 1774811437.738901}
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX47084') HTTP/1.1" 204 0
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-29 19:10:37 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-29 19:10:37 [auto1.nl] INFO: Scrape type for EY85081: 2
2026-03-29 19:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-29 19:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 608255fa-49ac-5b03-af1c-6a8855f26943 with scrape type 2
2026-03-29 19:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 608255fa-49ac-5b03-af1c-6a8855f26943 with scrape type 2
2026-03-29 19:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 608255fa-49ac-5b03-af1c-6a8855f26943, identifier: EY85081
2026-03-29 19:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-29 19:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-29 19:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081 to the API
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:35Z',
 'fuel_type': 'petrol',
 'id': '608255fa-49ac-5b03-af1c-6a8855f26943',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY85081',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 132697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-29 19:10:38 [auto1.nl] INFO: Saving data for EY85081: {'auction_closing_time': 1774884995.0, 'created_time': 1774613495.617623, 'last_price_update_time': 1774811438.230913}
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY85081') HTTP/1.1" 204 0
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-29 19:10:38 [auto1.nl] INFO: Scrape type for AC84495: 0
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-29 19:10:38 [auto1.nl] INFO: Scrape type for FK48987: 0
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-29 19:10:38 [auto1.nl] INFO: Scrape type for MD18353: 0
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-29 19:10:38 [auto1.nl] INFO: Scrape type for FP18275: 2
2026-03-29 19:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-29 19:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c58ffe-f265-56ac-a40a-3ef24aa59319 with scrape type 2
2026-03-29 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c58ffe-f265-56ac-a40a-3ef24aa59319 with scrape type 2
2026-03-29 19:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 06c58ffe-f265-56ac-a40a-3ef24aa59319, identifier: FP18275
2026-03-29 19:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-29 19:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-29 19:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275 to the API
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:44Z',
 'fuel_type': 'diesel',
 'id': '06c58ffe-f265-56ac-a40a-3ef24aa59319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP18275',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 295232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-29 19:10:38 [auto1.nl] INFO: Saving data for FP18275: {'auction_closing_time': 1774885304.0, 'created_time': 1774613496.826994, 'last_price_update_time': 1774811438.744243}
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP18275') HTTP/1.1" 204 0
2026-03-29 19:10:38 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-29 19:10:38 [auto1.nl] INFO: Scrape type for BV58634: 2
2026-03-29 19:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-29 19:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fb2b73-5837-529b-a0ca-24316a72a084 with scrape type 2
2026-03-29 19:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34fb2b73-5837-529b-a0ca-24316a72a084 with scrape type 2
2026-03-29 19:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34fb2b73-5837-529b-a0ca-24316a72a084, identifier: BV58634
2026-03-29 19:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-29 19:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-29 19:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634 to the API
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:02:41Z',
 'fuel_type': 'petrol',
 'id': '34fb2b73-5837-529b-a0ca-24316a72a084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV58634',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 241773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-06-06',
 'seller_name': None,
 'title': 'Toyota RAV 4 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-29 19:10:39 [auto1.nl] INFO: Saving data for BV58634: {'auction_closing_time': 1774882961.0, 'created_time': 1774613490.507858, 'last_price_update_time': 1774811439.305635}
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV58634') HTTP/1.1" 204 0
2026-03-29 19:10:39 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-29 19:10:39 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-29 19:10:39 [auto1.nl] INFO: Scrape type for JM47469: 2
2026-03-29 19:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-29 19:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da668c5-d576-5a87-9220-bd2dd3339164 with scrape type 2
2026-03-29 19:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0da668c5-d576-5a87-9220-bd2dd3339164 with scrape type 2
2026-03-29 19:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0da668c5-d576-5a87-9220-bd2dd3339164, identifier: JM47469
2026-03-29 19:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-29 19:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469
2026-03-29 19:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0da668c5-d576-5a87-9220-bd2dd3339164 with identifier: JM47469 to the API
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 270,
 'expiration_date': '2026-03-30T15:26:00Z',
 'fuel_type': 'petrol',
 'id': '0da668c5-d576-5a87-9220-bd2dd3339164',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM47469',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 181452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI R',
 'transmission': 'automatic',
 'trim': 'R',
 'year': 2011}
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-29 19:10:39 [auto1.nl] INFO: Saving data for JM47469: {'auction_closing_time': 1774884360.0, 'created_time': 1773924169.410504, 'last_price_update_time': 1774811439.703898}
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM47469') HTTP/1.1" 204 0
2026-03-29 19:10:39 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-29 19:10:39 [auto1.nl] INFO: Scrape type for FL63517: 0
2026-03-29 19:10:39 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-29 19:10:39 [auto1.nl] INFO: Scrape type for BM96536: 0
2026-03-29 19:10:39 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-29 19:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:40 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:40 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-29 19:10:40 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-29 19:10:40 [auto1.nl] INFO: Scrape type for WP95967: 0
2026-03-29 19:10:40 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-29 19:10:40 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-29 19:10:40 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-29 19:10:40 [auto1.nl] INFO: Scrape type for ZL63379: 2
2026-03-29 19:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-29 19:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b266567-6345-5a83-bee7-618f3c719214 with scrape type 2
2026-03-29 19:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b266567-6345-5a83-bee7-618f3c719214 with scrape type 2
2026-03-29 19:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7b266567-6345-5a83-bee7-618f3c719214, identifier: ZL63379
2026-03-29 19:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-29 19:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-29 19:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379 to the API
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:46:44Z',
 'fuel_type': 'petrol',
 'id': '7b266567-6345-5a83-bee7-618f3c719214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL63379',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 99854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-29 19:10:40 [auto1.nl] INFO: Saving data for ZL63379: {'auction_closing_time': 1774885604.0, 'created_time': 1774293145.040534, 'last_price_update_time': 1774811440.491271}
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL63379') HTTP/1.1" 204 0
2026-03-29 19:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:40 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW60386%27 HTTP/1.1" 200 None
2026-03-29 19:10:40 [auto1.nl] INFO: Scrape type for MW60386: 2
2026-03-29 19:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with identifier: MW60386
2026-03-29 19:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with scrape type 2
2026-03-29 19:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with scrape type 2
2026-03-29 19:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c, identifier: MW60386
2026-03-29 19:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with identifier: MW60386
2026-03-29 19:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with identifier: MW60386
2026-03-29 19:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c with identifier: MW60386 to the API
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:20:51Z',
 'fuel_type': 'petrol',
 'id': 'bf5c0c15-03c3-5f5e-a3cf-1bb7821d649c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW60386',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Roadster',
 'odometer': 201161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-21',
 'seller_name': None,
 'title': 'MINI Roadster Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW60386%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Saving data for MW60386: {'auction_closing_time': 1774884051.0, 'created_time': 1774725040.064652, 'last_price_update_time': 1774811441.032073}
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW60386') HTTP/1.1" 204 0
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Scrape type for CM00428: 0
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Scrape type for FJ00169: 2
2026-03-29 19:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-29 19:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with scrape type 2
2026-03-29 19:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with scrape type 2
2026-03-29 19:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6fdcb6b-feb2-5129-9cd6-89a41582fd14, identifier: FJ00169
2026-03-29 19:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-29 19:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-29 19:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169 to the API
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:06Z',
 'fuel_type': 'diesel',
 'id': 'd6fdcb6b-feb2-5129-9cd6-89a41582fd14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ00169',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 170008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2020}
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Saving data for FJ00169: {'auction_closing_time': 1774886226.0, 'created_time': 1774527062.760754, 'last_price_update_time': 1774811441.441318}
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ00169') HTTP/1.1" 204 0
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Scrape type for GP63449: 2
2026-03-29 19:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-29 19:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e334de-e05e-58a4-a382-d478bd0810e7 with scrape type 2
2026-03-29 19:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e334de-e05e-58a4-a382-d478bd0810e7 with scrape type 2
2026-03-29 19:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 22e334de-e05e-58a4-a382-d478bd0810e7, identifier: GP63449
2026-03-29 19:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-29 19:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-29 19:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449 to the API
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:40:50Z',
 'fuel_type': 'hybrid',
 'id': '22e334de-e05e-58a4-a382-d478bd0810e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP63449',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 250449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-30',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Instyle 4WD',
 'year': 2013}
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Saving data for GP63449: {'auction_closing_time': 1774885250.0, 'created_time': 1774613447.070463, 'last_price_update_time': 1774811441.871415}
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GP63449') HTTP/1.1" 204 0
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Scrape type for BZ75535: 0
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Scrape type for PE89486: 0
2026-03-29 19:10:41 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-29 19:10:41 [auto1.nl] INFO: Scrape type for CR31925: 2
2026-03-29 19:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-29 19:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with scrape type 2
2026-03-29 19:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with scrape type 2
2026-03-29 19:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6, identifier: CR31925
2026-03-29 19:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-29 19:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-29 19:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925 to the API
2026-03-29 19:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:48:47Z',
 'fuel_type': 'hybrid',
 'id': 'e8423ee1-8d09-5c80-a8df-ebb9725d2cb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR31925',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 198921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-29 19:10:42 [auto1.nl] INFO: Saving data for CR31925: {'auction_closing_time': 1774885727.0, 'created_time': 1773688307.528593, 'last_price_update_time': 1774811442.910757}
2026-03-29 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR31925') HTTP/1.1" 204 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Scrape type for UR99157: 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Scrape type for ZX00670: 2
2026-03-29 19:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-29 19:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09fb35d5-3846-5eec-80ae-148ce1f277a3 with scrape type 2
2026-03-29 19:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09fb35d5-3846-5eec-80ae-148ce1f277a3 with scrape type 2
2026-03-29 19:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 09fb35d5-3846-5eec-80ae-148ce1f277a3, identifier: ZX00670
2026-03-29 19:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-29 19:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-29 19:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670 to the API
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:41:32Z',
 'fuel_type': 'petrol',
 'id': '09fb35d5-3846-5eec-80ae-148ce1f277a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX00670',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 104119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-07',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Saving data for ZX00670: {'auction_closing_time': 1774885292.0, 'created_time': 1774527030.190597, 'last_price_update_time': 1774811443.397586}
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZX00670') HTTP/1.1" 204 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Scrape type for NP69601: 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Scrape type for SR40415: 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Scrape type for NR15886: 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Scrape type for FL22944: 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-29 19:10:43 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-29 19:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:43 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:43 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-29 19:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-29 19:10:44 [auto1.nl] INFO: Scrape type for CK43593: 2
2026-03-29 19:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-29 19:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with scrape type 2
2026-03-29 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with scrape type 2
2026-03-29 19:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595, identifier: CK43593
2026-03-29 19:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-29 19:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-29 19:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593 to the API
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:05:53Z',
 'fuel_type': 'hybrid',
 'id': '460e7c1b-55ba-5cb7-8b3b-97a5defd2595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK43593',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 83270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-29 19:10:44 [auto1.nl] INFO: Saving data for CK43593: {'auction_closing_time': 1774883153.0, 'created_time': 1773861137.497922, 'last_price_update_time': 1774811444.405217}
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CK43593') HTTP/1.1" 204 0
2026-03-29 19:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-29 19:10:44 [auto1.nl] INFO: Scrape type for SV78620: 2
2026-03-29 19:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-29 19:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ff8b98-3084-5d24-b564-e88479fc5c4f with scrape type 2
2026-03-29 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31ff8b98-3084-5d24-b564-e88479fc5c4f with scrape type 2
2026-03-29 19:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 31ff8b98-3084-5d24-b564-e88479fc5c4f, identifier: SV78620
2026-03-29 19:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-29 19:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-29 19:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620 to the API
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:05Z',
 'fuel_type': 'diesel',
 'id': '31ff8b98-3084-5d24-b564-e88479fc5c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV78620',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 150133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-29 19:10:44 [auto1.nl] INFO: Saving data for SV78620: {'auction_closing_time': 1774886345.0, 'created_time': 1773132445.149576, 'last_price_update_time': 1774811444.917505}
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV78620') HTTP/1.1" 204 0
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-29 19:10:44 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-29 19:10:44 [auto1.nl] INFO: Scrape type for YZ85937: 2
2026-03-29 19:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-29 19:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4119aee-b299-554e-a3e1-8b46b6b38066 with scrape type 2
2026-03-29 19:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4119aee-b299-554e-a3e1-8b46b6b38066 with scrape type 2
2026-03-29 19:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a4119aee-b299-554e-a3e1-8b46b6b38066, identifier: YZ85937
2026-03-29 19:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-29 19:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-29 19:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937 to the API
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-30T15:17:22Z',
 'fuel_type': 'petrol',
 'id': 'a4119aee-b299-554e-a3e1-8b46b6b38066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ85937',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-05',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Sportway',
 'transmission': 'manual',
 'trim': 'Sportway',
 'year': 2006}
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-29 19:10:45 [auto1.nl] INFO: Saving data for YZ85937: {'auction_closing_time': 1774883842.0, 'created_time': 1774613435.854893, 'last_price_update_time': 1774811445.33442}
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ85937') HTTP/1.1" 204 0
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-29 19:10:45 [auto1.nl] INFO: Scrape type for MZ50492: 0
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-29 19:10:45 [auto1.nl] INFO: Scrape type for UY18740: 0
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-29 19:10:45 [auto1.nl] INFO: Scrape type for UJ05110: 0
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-29 19:10:45 [auto1.nl] INFO: Scrape type for XG57923: 0
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-29 19:10:45 [auto1.nl] INFO: Scrape type for RP15329: 2
2026-03-29 19:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-29 19:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e36aaa-9465-5f90-b367-9e8c15905c1d with scrape type 2
2026-03-29 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6e36aaa-9465-5f90-b367-9e8c15905c1d with scrape type 2
2026-03-29 19:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6e36aaa-9465-5f90-b367-9e8c15905c1d, identifier: RP15329
2026-03-29 19:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-29 19:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-29 19:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329 to the API
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:40:44Z',
 'fuel_type': 'petrol',
 'id': 'e6e36aaa-9465-5f90-b367-9e8c15905c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP15329',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 182578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-12',
 'seller_name': None,
 'title': 'BMW 3er 316ti',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-29 19:10:45 [auto1.nl] INFO: Saving data for RP15329: {'auction_closing_time': 1774885244.0, 'created_time': 1773663987.605195, 'last_price_update_time': 1774811445.917006}
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RP15329') HTTP/1.1" 204 0
2026-03-29 19:10:45 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-29 19:10:45 [auto1.nl] INFO: Scrape type for VM41876: 2
2026-03-29 19:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-29 19:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7af47009-9baf-5d8b-8363-fd8d084171a4 with scrape type 2
2026-03-29 19:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7af47009-9baf-5d8b-8363-fd8d084171a4 with scrape type 2
2026-03-29 19:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7af47009-9baf-5d8b-8363-fd8d084171a4, identifier: VM41876
2026-03-29 19:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-29 19:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-29 19:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876 to the API
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:50Z',
 'fuel_type': 'petrol',
 'id': '7af47009-9baf-5d8b-8363-fd8d084171a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM41876',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 109195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-29 19:10:46 [auto1.nl] INFO: Saving data for VM41876: {'auction_closing_time': 1774884650.0, 'created_time': 1774613424.217106, 'last_price_update_time': 1774811446.34573}
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VM41876') HTTP/1.1" 204 0
2026-03-29 19:10:46 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-29 19:10:46 [auto1.nl] INFO: Scrape type for FH34143: 0
2026-03-29 19:10:46 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-29 19:10:46 [auto1.nl] INFO: Scrape type for FW39949: 0
2026-03-29 19:10:46 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-29 19:10:46 [auto1.nl] INFO: Scrape type for ZP69271: 2
2026-03-29 19:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-29 19:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a0c88c-cd3b-5216-a731-7031ed886f19 with scrape type 2
2026-03-29 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2a0c88c-cd3b-5216-a731-7031ed886f19 with scrape type 2
2026-03-29 19:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c2a0c88c-cd3b-5216-a731-7031ed886f19, identifier: ZP69271
2026-03-29 19:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-29 19:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-29 19:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271 to the API
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:44:33Z',
 'fuel_type': 'diesel',
 'id': 'c2a0c88c-cd3b-5216-a731-7031ed886f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP69271',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 237750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2013}
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-29 19:10:46 [auto1.nl] INFO: Saving data for ZP69271: {'auction_closing_time': 1774885473.0, 'created_time': 1773343026.850206, 'last_price_update_time': 1774811446.838533}
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP69271') HTTP/1.1" 204 0
2026-03-29 19:10:46 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-29 19:10:46 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-29 19:10:46 [auto1.nl] INFO: Scrape type for VD56637: 2
2026-03-29 19:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-29 19:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e083aad3-7d95-5383-a11e-66a3df59ba04 with scrape type 2
2026-03-29 19:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e083aad3-7d95-5383-a11e-66a3df59ba04 with scrape type 2
2026-03-29 19:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e083aad3-7d95-5383-a11e-66a3df59ba04, identifier: VD56637
2026-03-29 19:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-29 19:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-29 19:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637 to the API
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:55Z',
 'fuel_type': 'petrol',
 'id': 'e083aad3-7d95-5383-a11e-66a3df59ba04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD56637',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 69047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2020}
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-29 19:10:47 [auto1.nl] INFO: Saving data for VD56637: {'auction_closing_time': 1774885135.0, 'created_time': 1774527026.955858, 'last_price_update_time': 1774811447.317893}
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD56637') HTTP/1.1" 204 0
2026-03-29 19:10:47 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-29 19:10:47 [auto1.nl] INFO: Scrape type for BY94157: 0
2026-03-29 19:10:47 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-29 19:10:47 [auto1.nl] INFO: Scrape type for JK88621: 0
2026-03-29 19:10:47 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-29 19:10:47 [auto1.nl] INFO: Scrape type for WX34396: 2
2026-03-29 19:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-29 19:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with scrape type 2
2026-03-29 19:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with scrape type 2
2026-03-29 19:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca912cb0-dad5-54f1-afe8-fd69f13b23b9, identifier: WX34396
2026-03-29 19:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-29 19:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396
2026-03-29 19:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca912cb0-dad5-54f1-afe8-fd69f13b23b9 with identifier: WX34396 to the API
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:23:25Z',
 'fuel_type': 'petrol',
 'id': 'ca912cb0-dad5-54f1-afe8-fd69f13b23b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX34396',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 201587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-23',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-29 19:10:47 [auto1.nl] INFO: Saving data for WX34396: {'auction_closing_time': 1774884205.0, 'created_time': 1773132428.349442, 'last_price_update_time': 1774811447.740224}
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WX34396') HTTP/1.1" 204 0
2026-03-29 19:10:47 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-29 19:10:47 [auto1.nl] INFO: Scrape type for XD61678: 0
2026-03-29 19:10:47 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-29 19:10:47 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-29 19:10:47 [auto1.nl] INFO: Scrape type for YK98733: 0
2026-03-29 19:10:47 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-29 19:10:47 [auto1.nl] INFO: Scrape type for YP25238: 2
2026-03-29 19:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-29 19:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5709728-0d97-54c9-b0dc-28a10eeef62f with scrape type 2
2026-03-29 19:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5709728-0d97-54c9-b0dc-28a10eeef62f with scrape type 2
2026-03-29 19:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a5709728-0d97-54c9-b0dc-28a10eeef62f, identifier: YP25238
2026-03-29 19:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-29 19:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-29 19:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238 to the API
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:31:45Z',
 'fuel_type': 'petrol',
 'id': 'a5709728-0d97-54c9-b0dc-28a10eeef62f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP25238',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 142860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-29 19:10:48 [auto1.nl] INFO: Saving data for YP25238: {'auction_closing_time': 1774884705.0, 'created_time': 1774527040.493971, 'last_price_update_time': 1774811448.172005}
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YP25238') HTTP/1.1" 204 0
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-29 19:10:48 [auto1.nl] INFO: Scrape type for HD17412: 0
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-29 19:10:48 [auto1.nl] INFO: Scrape type for ES69537: 2
2026-03-29 19:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-29 19:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with scrape type 2
2026-03-29 19:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with scrape type 2
2026-03-29 19:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c06f76bb-78a1-59c3-8429-b24b0bd15fe7, identifier: ES69537
2026-03-29 19:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-29 19:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-29 19:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537 to the API
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:28Z',
 'fuel_type': 'petrol',
 'id': 'c06f76bb-78a1-59c3-8429-b24b0bd15fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES69537',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 134147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2019}
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-29 19:10:48 [auto1.nl] INFO: Saving data for ES69537: {'auction_closing_time': 1774883788.0, 'created_time': 1774613492.143398, 'last_price_update_time': 1774811448.608372}
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ES69537') HTTP/1.1" 204 0
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-29 19:10:48 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-29 19:10:48 [auto1.nl] INFO: Scrape type for CR08212: 0
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-29 19:10:48 [auto1.nl] INFO: Scrape type for GN05115: 0
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-29 19:10:48 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-29 19:10:48 [auto1.nl] INFO: Scrape type for CT54062: 2
2026-03-29 19:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-29 19:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1158f01-7d72-5e4e-a742-1f164b3c10f0 with scrape type 2
2026-03-29 19:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1158f01-7d72-5e4e-a742-1f164b3c10f0 with scrape type 2
2026-03-29 19:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1158f01-7d72-5e4e-a742-1f164b3c10f0, identifier: CT54062
2026-03-29 19:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 19:10:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-29 19:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062 to the API
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:18:07Z',
 'fuel_type': 'petrol',
 'id': 'c1158f01-7d72-5e4e-a742-1f164b3c10f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT54062',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 25088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-09',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2023}
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-29 19:10:49 [auto1.nl] INFO: Saving data for CT54062: {'auction_closing_time': 1774883887.0, 'created_time': 1773232326.734161, 'last_price_update_time': 1774811449.236505}
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT54062') HTTP/1.1" 204 0
2026-03-29 19:10:49 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-29 19:10:49 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-29 19:10:49 [auto1.nl] INFO: Scrape type for RY75066: 0
2026-03-29 19:10:49 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-29 19:10:49 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-29 19:10:49 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-29 19:10:49 [auto1.nl] INFO: Scrape type for CJ41969: 2
2026-03-29 19:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-29 19:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989cd8af-4413-519c-8a53-52c650ff5aaf with scrape type 2
2026-03-29 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 989cd8af-4413-519c-8a53-52c650ff5aaf with scrape type 2
2026-03-29 19:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 989cd8af-4413-519c-8a53-52c650ff5aaf, identifier: CJ41969
2026-03-29 19:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-29 19:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-29 19:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969 to the API
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:58:29Z',
 'fuel_type': 'diesel',
 'id': '989cd8af-4413-519c-8a53-52c650ff5aaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ41969',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 175739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-13',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2014}
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-29 19:10:49 [auto1.nl] INFO: Saving data for CJ41969: {'auction_closing_time': 1774886309.0, 'created_time': 1773342965.438828, 'last_price_update_time': 1774811449.683637}
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ41969') HTTP/1.1" 204 0
2026-03-29 19:10:49 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-29 19:10:49 [auto1.nl] INFO: Scrape type for BD37870: 0
2026-03-29 19:10:49 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-29 19:10:49 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-29 19:10:49 [auto1.nl] INFO: Scrape type for WK29789: 2
2026-03-29 19:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-29 19:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6817a3df-020f-50e7-bb25-2b9bd824fefb with scrape type 2
2026-03-29 19:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6817a3df-020f-50e7-bb25-2b9bd824fefb with scrape type 2
2026-03-29 19:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6817a3df-020f-50e7-bb25-2b9bd824fefb, identifier: WK29789
2026-03-29 19:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-29 19:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-29 19:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789 to the API
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:34:03Z',
 'fuel_type': 'petrol',
 'id': '6817a3df-020f-50e7-bb25-2b9bd824fefb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK29789',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 143827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-29 19:10:50 [auto1.nl] INFO: Saving data for WK29789: {'auction_closing_time': 1774884843.0, 'created_time': 1773688299.871507, 'last_price_update_time': 1774811450.223716}
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK29789') HTTP/1.1" 204 0
2026-03-29 19:10:50 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-29 19:10:50 [auto1.nl] INFO: Scrape type for EL29526: 0
2026-03-29 19:10:50 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-29 19:10:50 [auto1.nl] INFO: Scrape type for KV87922: 0
2026-03-29 19:10:50 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-29 19:10:50 [auto1.nl] INFO: Scrape type for CP17463: 2
2026-03-29 19:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-29 19:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with scrape type 2
2026-03-29 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with scrape type 2
2026-03-29 19:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e, identifier: CP17463
2026-03-29 19:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-29 19:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-29 19:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463 to the API
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:08Z',
 'fuel_type': 'petrol',
 'id': '7d8c1458-b76f-53bf-a51d-32c1a8a1c61e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP17463',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 67884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-06',
 'seller_name': None,
 'title': 'Ford B-Max 1.6 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-29 19:10:50 [auto1.nl] INFO: Saving data for CP17463: {'auction_closing_time': 1774883708.0, 'created_time': 1774527050.199928, 'last_price_update_time': 1774811450.636027}
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP17463') HTTP/1.1" 204 0
2026-03-29 19:10:50 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-29 19:10:50 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-29 19:10:50 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-29 19:10:50 [auto1.nl] INFO: Scrape type for WW80908: 2
2026-03-29 19:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-29 19:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4160835d-5ef4-5a94-b15c-6729c011c026 with scrape type 2
2026-03-29 19:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4160835d-5ef4-5a94-b15c-6729c011c026 with scrape type 2
2026-03-29 19:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4160835d-5ef4-5a94-b15c-6729c011c026, identifier: WW80908
2026-03-29 19:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-29 19:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-29 19:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908 to the API
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:43:04Z',
 'fuel_type': 'petrol',
 'id': '4160835d-5ef4-5a94-b15c-6729c011c026',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW80908',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 191966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-29 19:10:51 [auto1.nl] INFO: Saving data for WW80908: {'auction_closing_time': 1774885384.0, 'created_time': 1773924229.472728, 'last_price_update_time': 1774811451.079813}
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WW80908') HTTP/1.1" 204 0
2026-03-29 19:10:51 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-29 19:10:51 [auto1.nl] INFO: Scrape type for SM80467: 2
2026-03-29 19:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-29 19:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with scrape type 2
2026-03-29 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with scrape type 2
2026-03-29 19:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c, identifier: SM80467
2026-03-29 19:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-29 19:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-29 19:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467 to the API
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:49:56Z',
 'fuel_type': 'diesel',
 'id': '3f328af6-a62d-5d37-9d2d-d0a0ad71628c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM80467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 144623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 213 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-29 19:10:51 [auto1.nl] INFO: Saving data for SM80467: {'auction_closing_time': 1774885796.0, 'created_time': 1774527068.884699, 'last_price_update_time': 1774811451.490804}
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SM80467') HTTP/1.1" 204 0
2026-03-29 19:10:51 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-29 19:10:51 [auto1.nl] INFO: Scrape type for EH64896: 0
2026-03-29 19:10:51 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-29 19:10:51 [auto1.nl] INFO: Scrape type for DB11708: 0
2026-03-29 19:10:51 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-29 19:10:51 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-29 19:10:51 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX51139%27 HTTP/1.1" 200 None
2026-03-29 19:10:51 [auto1.nl] INFO: Scrape type for PX51139: 2
2026-03-29 19:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50ff2179-b296-5132-8512-40ad03981452 with identifier: PX51139
2026-03-29 19:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ff2179-b296-5132-8512-40ad03981452 with scrape type 2
2026-03-29 19:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50ff2179-b296-5132-8512-40ad03981452 with scrape type 2
2026-03-29 19:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 50ff2179-b296-5132-8512-40ad03981452, identifier: PX51139
2026-03-29 19:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 50ff2179-b296-5132-8512-40ad03981452 with identifier: PX51139
2026-03-29 19:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 50ff2179-b296-5132-8512-40ad03981452 with identifier: PX51139
2026-03-29 19:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 50ff2179-b296-5132-8512-40ad03981452 with identifier: PX51139 to the API
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:16Z',
 'fuel_type': 'diesel',
 'id': '50ff2179-b296-5132-8512-40ad03981452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX51139',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 37980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-13',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Kasten BlueMotion',
 'year': 2019}
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX51139%27 HTTP/1.1" 200 None
2026-03-29 19:10:51 [auto1.nl] INFO: Saving data for PX51139: {'auction_closing_time': 1774885336.0, 'created_time': 1774033840.576853, 'last_price_update_time': 1774811451.886964}
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PX51139') HTTP/1.1" 204 0
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-29 19:10:52 [auto1.nl] INFO: Scrape type for AZ42388: 0
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-29 19:10:52 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-29 19:10:52 [auto1.nl] INFO: Scrape type for TW55830: 0
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-29 19:10:52 [auto1.nl] INFO: Scrape type for BU16200: 2
2026-03-29 19:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-29 19:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with scrape type 2
2026-03-29 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with scrape type 2
2026-03-29 19:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81, identifier: BU16200
2026-03-29 19:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-29 19:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-29 19:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200 to the API
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:58:27Z',
 'fuel_type': 'petrol',
 'id': 'a1d476b6-ca15-5b1b-b633-eafb1a6a0d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU16200',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 25962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium Business',
 'transmission': 'automatic',
 'trim': 'Titanium Business',
 'year': 2019}
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-29 19:10:52 [auto1.nl] INFO: Saving data for BU16200: {'auction_closing_time': 1774886307.0, 'created_time': 1774613474.66408, 'last_price_update_time': 1774811452.506543}
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU16200') HTTP/1.1" 204 0
2026-03-29 19:10:52 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-29 19:10:52 [auto1.nl] INFO: Scrape type for PA43644: 2
2026-03-29 19:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-29 19:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with scrape type 2
2026-03-29 19:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with scrape type 2
2026-03-29 19:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705, identifier: PA43644
2026-03-29 19:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 19:10:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-29 19:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644 to the API
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:23:20Z',
 'fuel_type': 'hybrid',
 'id': '3c1ae3d0-e1ec-52cb-893e-61e62c7d3705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA43644',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 32375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-10',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Intuitive 2WD',
 'transmission': 'automatic',
 'trim': 'Intuitive 2WD',
 'year': 2023}
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-29 19:10:53 [auto1.nl] INFO: Saving data for PA43644: {'auction_closing_time': 1774884200.0, 'created_time': 1773229580.841529, 'last_price_update_time': 1774811453.071241}
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA43644') HTTP/1.1" 204 0
2026-03-29 19:10:53 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-29 19:10:53 [auto1.nl] INFO: Scrape type for HC58225: 0
2026-03-29 19:10:53 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-29 19:10:53 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-29 19:10:53 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-29 19:10:53 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-29 19:10:53 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-29 19:10:53 [auto1.nl] INFO: Scrape type for SY53039: 2
2026-03-29 19:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-29 19:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ae6fc4-df0c-537e-bfeb-79779142b37c with scrape type 2
2026-03-29 19:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ae6fc4-df0c-537e-bfeb-79779142b37c with scrape type 2
2026-03-29 19:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02ae6fc4-df0c-537e-bfeb-79779142b37c, identifier: SY53039
2026-03-29 19:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-29 19:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-29 19:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039 to the API
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:07:35Z',
 'fuel_type': 'diesel',
 'id': '02ae6fc4-df0c-537e-bfeb-79779142b37c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY53039',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV250',
 'odometer': 190282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-25',
 'seller_name': None,
 'title': 'Nissan NV250 1.5 dCi L1H1 2,0t Comfort',
 'transmission': 'manual',
 'trim': 'L1H1 2,0t Comfort',
 'year': 2019}
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-29 19:10:53 [auto1.nl] INFO: Saving data for SY53039: {'auction_closing_time': 1774883255.0, 'created_time': 1774613447.733057, 'last_price_update_time': 1774811453.549645}
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY53039') HTTP/1.1" 204 0
2026-03-29 19:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:53 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:53 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-29 19:10:53 [auto1.nl] INFO: Scrape type for DN96174: 2
2026-03-29 19:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-29 19:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec40764-0309-5557-b786-0425ed702cb4 with scrape type 2
2026-03-29 19:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec40764-0309-5557-b786-0425ed702cb4 with scrape type 2
2026-03-29 19:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eec40764-0309-5557-b786-0425ed702cb4, identifier: DN96174
2026-03-29 19:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-29 19:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-29 19:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174 to the API
2026-03-29 19:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:50:38Z',
 'fuel_type': 'petrol',
 'id': 'eec40764-0309-5557-b786-0425ed702cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN96174',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 133526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Renault Clio 1.6 TCe Renault Sport Trophy',
 'transmission': 'automatic',
 'trim': 'Sport Trophy',
 'year': 2016}
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-29 19:10:54 [auto1.nl] INFO: Saving data for DN96174: {'auction_closing_time': 1774885838.0, 'created_time': 1773924417.172091, 'last_price_update_time': 1774811454.166256}
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DN96174') HTTP/1.1" 204 0
2026-03-29 19:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:54 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-29 19:10:54 [auto1.nl] INFO: Scrape type for BD28084: 0
2026-03-29 19:10:54 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-29 19:10:54 [auto1.nl] INFO: Scrape type for SE84312: 2
2026-03-29 19:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-29 19:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189b5ee9-47ba-5495-b9f5-3697f87dccda with scrape type 2
2026-03-29 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189b5ee9-47ba-5495-b9f5-3697f87dccda with scrape type 2
2026-03-29 19:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 189b5ee9-47ba-5495-b9f5-3697f87dccda, identifier: SE84312
2026-03-29 19:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-29 19:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-29 19:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312 to the API
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:53:08Z',
 'fuel_type': 'petrol',
 'id': '189b5ee9-47ba-5495-b9f5-3697f87dccda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE84312',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 21936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-12',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-29 19:10:54 [auto1.nl] INFO: Saving data for SE84312: {'auction_closing_time': 1774885988.0, 'created_time': 1774527021.539652, 'last_price_update_time': 1774811454.580463}
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE84312') HTTP/1.1" 204 0
2026-03-29 19:10:54 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-29 19:10:54 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-29 19:10:54 [auto1.nl] INFO: Scrape type for DZ87358: 2
2026-03-29 19:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-29 19:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with scrape type 2
2026-03-29 19:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with scrape type 2
2026-03-29 19:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d, identifier: DZ87358
2026-03-29 19:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-29 19:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-29 19:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358 to the API
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'diesel',
 'id': 'b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ87358',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 200238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-23',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-29 19:10:54 [auto1.nl] INFO: Saving data for DZ87358: {'auction_closing_time': 1774883687.0, 'created_time': 1774613499.48183, 'last_price_update_time': 1774811454.990695}
2026-03-29 19:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DZ87358') HTTP/1.1" 204 0
2026-03-29 19:10:55 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-29 19:10:55 [auto1.nl] INFO: Scrape type for LE78061: 2
2026-03-29 19:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-29 19:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with scrape type 2
2026-03-29 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with scrape type 2
2026-03-29 19:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9, identifier: LE78061
2026-03-29 19:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-29 19:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-29 19:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061 to the API
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:20:52Z',
 'fuel_type': 'petrol',
 'id': 'b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE78061',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 58522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-29 19:10:55 [auto1.nl] INFO: Saving data for LE78061: {'auction_closing_time': 1774884052.0, 'created_time': 1774527077.464881, 'last_price_update_time': 1774811455.387749}
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE78061') HTTP/1.1" 204 0
2026-03-29 19:10:55 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-29 19:10:55 [auto1.nl] INFO: Scrape type for RC74228: 2
2026-03-29 19:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-29 19:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31976e2f-167d-5f4f-9a04-ea038cb88b30 with scrape type 2
2026-03-29 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31976e2f-167d-5f4f-9a04-ea038cb88b30 with scrape type 2
2026-03-29 19:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 31976e2f-167d-5f4f-9a04-ea038cb88b30, identifier: RC74228
2026-03-29 19:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-29 19:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-29 19:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228 to the API
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:56:40Z',
 'fuel_type': 'petrol',
 'id': '31976e2f-167d-5f4f-9a04-ea038cb88b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC74228',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 209670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-29 19:10:55 [auto1.nl] INFO: Saving data for RC74228: {'auction_closing_time': 1774886200.0, 'created_time': 1773688671.00132, 'last_price_update_time': 1774811455.797053}
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC74228') HTTP/1.1" 204 0
2026-03-29 19:10:55 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-29 19:10:55 [auto1.nl] INFO: Scrape type for MD57319: 2
2026-03-29 19:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-29 19:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32679f86-f323-5b96-9066-2c2a4418452c with scrape type 2
2026-03-29 19:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32679f86-f323-5b96-9066-2c2a4418452c with scrape type 2
2026-03-29 19:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32679f86-f323-5b96-9066-2c2a4418452c, identifier: MD57319
2026-03-29 19:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-29 19:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-29 19:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319 to the API
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:18:22Z',
 'fuel_type': 'petrol',
 'id': '32679f86-f323-5b96-9066-2c2a4418452c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD57319',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 78243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-24',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2011}
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-29 19:10:56 [auto1.nl] INFO: Saving data for MD57319: {'auction_closing_time': 1774883902.0, 'created_time': 1774527034.780978, 'last_price_update_time': 1774811456.164126}
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD57319') HTTP/1.1" 204 0
2026-03-29 19:10:56 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-29 19:10:56 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-29 19:10:56 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-29 19:10:56 [auto1.nl] INFO: Scrape type for NT33284: 2
2026-03-29 19:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-29 19:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with scrape type 2
2026-03-29 19:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with scrape type 2
2026-03-29 19:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af, identifier: NT33284
2026-03-29 19:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-29 19:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-29 19:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284 to the API
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:47:41Z',
 'fuel_type': 'petrol',
 'id': '65cd3790-8e0e-5c15-9d8e-519de9b0a4af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT33284',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 111701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-29 19:10:56 [auto1.nl] INFO: Saving data for NT33284: {'auction_closing_time': 1774885661.0, 'created_time': 1773688667.240473, 'last_price_update_time': 1774811456.590193}
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT33284') HTTP/1.1" 204 0
2026-03-29 19:10:56 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-29 19:10:56 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-29 19:10:56 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-29 19:10:56 [auto1.nl] INFO: Scrape type for FR68688: 2
2026-03-29 19:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-29 19:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with scrape type 2
2026-03-29 19:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with scrape type 2
2026-03-29 19:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 76a1108c-b5d7-57a0-89e5-34b437f0fb40, identifier: FR68688
2026-03-29 19:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-29 19:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-29 19:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688 to the API
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:50:38Z',
 'fuel_type': 'petrol',
 'id': '76a1108c-b5d7-57a0-89e5-34b437f0fb40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR68688',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 270252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-05',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2011}
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-29 19:10:57 [auto1.nl] INFO: Saving data for FR68688: {'auction_closing_time': 1774885838.0, 'created_time': 1774613498.176328, 'last_price_update_time': 1774811457.011309}
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR68688') HTTP/1.1" 204 0
2026-03-29 19:10:57 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-29 19:10:57 [auto1.nl] INFO: Scrape type for AE06801: 2
2026-03-29 19:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-29 19:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfff64aa-bf53-54ac-a935-97ce27e75a3b with scrape type 2
2026-03-29 19:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfff64aa-bf53-54ac-a935-97ce27e75a3b with scrape type 2
2026-03-29 19:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cfff64aa-bf53-54ac-a935-97ce27e75a3b, identifier: AE06801
2026-03-29 19:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-29 19:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-29 19:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801 to the API
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:30:54Z',
 'fuel_type': 'diesel',
 'id': 'cfff64aa-bf53-54ac-a935-97ce27e75a3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE06801',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 114628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2017}
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-29 19:10:57 [auto1.nl] INFO: Saving data for AE06801: {'auction_closing_time': 1774884654.0, 'created_time': 1773301378.278136, 'last_price_update_time': 1774811457.536364}
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AE06801') HTTP/1.1" 204 0
2026-03-29 19:10:57 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-29 19:10:57 [auto1.nl] INFO: Scrape type for WF02577: 2
2026-03-29 19:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-29 19:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162352ca-fec2-50ef-9de6-4dcec3a559e4 with scrape type 2
2026-03-29 19:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162352ca-fec2-50ef-9de6-4dcec3a559e4 with scrape type 2
2026-03-29 19:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 162352ca-fec2-50ef-9de6-4dcec3a559e4, identifier: WF02577
2026-03-29 19:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-29 19:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577
2026-03-29 19:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 162352ca-fec2-50ef-9de6-4dcec3a559e4 with identifier: WF02577 to the API
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:01:03Z',
 'fuel_type': 'petrol',
 'id': '162352ca-fec2-50ef-9de6-4dcec3a559e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF02577',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 175463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Renault Megane 1.6 TCe Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-29 19:10:57 [auto1.nl] INFO: Saving data for WF02577: {'auction_closing_time': 1774882863.0, 'created_time': 1774638628.485381, 'last_price_update_time': 1774811457.922996}
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WF02577') HTTP/1.1" 204 0
2026-03-29 19:10:57 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-29 19:10:57 [auto1.nl] INFO: Scrape type for CH10226: 0
2026-03-29 19:10:57 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-29 19:10:57 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-29 19:10:57 [auto1.nl] INFO: Scrape type for BM26306: 2
2026-03-29 19:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-29 19:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28619a19-5b65-56e6-ac80-f71dc61fb231 with scrape type 2
2026-03-29 19:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28619a19-5b65-56e6-ac80-f71dc61fb231 with scrape type 2
2026-03-29 19:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28619a19-5b65-56e6-ac80-f71dc61fb231, identifier: BM26306
2026-03-29 19:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-29 19:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-29 19:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306 to the API
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:48Z',
 'fuel_type': 'petrol',
 'id': '28619a19-5b65-56e6-ac80-f71dc61fb231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM26306',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 172936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-17',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-29 19:10:58 [auto1.nl] INFO: Saving data for BM26306: {'auction_closing_time': 1774884888.0, 'created_time': 1774527026.469105, 'last_price_update_time': 1774811458.369092}
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM26306') HTTP/1.1" 204 0
2026-03-29 19:10:58 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 758 | hits on page: 40
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE94931%27 HTTP/1.1" 200 None
2026-03-29 19:10:58 [auto1.nl] INFO: Scrape type for NE94931: 0
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-29 19:10:58 [auto1.nl] INFO: Scrape type for JS13271: 0
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-29 19:10:58 [auto1.nl] INFO: Scrape type for WG27101: 2
2026-03-29 19:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-29 19:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with scrape type 2
2026-03-29 19:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with scrape type 2
2026-03-29 19:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f, identifier: WG27101
2026-03-29 19:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-29 19:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-29 19:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101 to the API
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:53:13Z',
 'fuel_type': 'petrol',
 'id': 'b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG27101',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 226784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-05',
 'seller_name': None,
 'title': 'BMW 3er 320i GT',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-29 19:10:58 [auto1.nl] INFO: Saving data for WG27101: {'auction_closing_time': 1774885993.0, 'created_time': 1773301517.942438, 'last_price_update_time': 1774811458.852336}
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG27101') HTTP/1.1" 204 0
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-29 19:10:58 [auto1.nl] INFO: Scrape type for GY41852: 0
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-29 19:10:58 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-29 19:10:58 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-29 19:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-29 19:10:59 [auto1.nl] INFO: Scrape type for UC91516: 2
2026-03-29 19:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-29 19:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a48e36-0870-5f29-851c-0c597c61f9d7 with scrape type 2
2026-03-29 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a48e36-0870-5f29-851c-0c597c61f9d7 with scrape type 2
2026-03-29 19:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28a48e36-0870-5f29-851c-0c597c61f9d7, identifier: UC91516
2026-03-29 19:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-29 19:10:59 [auto1.nl] INFO: Scrape type for UB80121: 2
2026-03-29 19:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-29 19:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a4ad5d-7d22-5014-b2dd-f17c86036076 with scrape type 2
2026-03-29 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a4ad5d-7d22-5014-b2dd-f17c86036076 with scrape type 2
2026-03-29 19:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 11a4ad5d-7d22-5014-b2dd-f17c86036076, identifier: UB80121
2026-03-29 19:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-29 19:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-29 19:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516 to the API
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-30T15:04:00Z',
 'fuel_type': 'petrol',
 'id': '28a48e36-0870-5f29-851c-0c597c61f9d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC91516',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 241806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-29 19:10:59 [auto1.nl] INFO: Saving data for UC91516: {'auction_closing_time': 1774883040.0, 'created_time': 1773861312.446374, 'last_price_update_time': 1774811459.477523}
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC91516') HTTP/1.1" 204 0
2026-03-29 19:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-29 19:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121
2026-03-29 19:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 11a4ad5d-7d22-5014-b2dd-f17c86036076 with identifier: UB80121 to the API
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'petrol',
 'id': '11a4ad5d-7d22-5014-b2dd-f17c86036076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB80121',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 63622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-24',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2005}
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-29 19:10:59 [auto1.nl] INFO: Saving data for UB80121: {'auction_closing_time': 1774885961.0, 'created_time': 1774638636.487429, 'last_price_update_time': 1774811459.848216}
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB80121') HTTP/1.1" 204 0
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-29 19:10:59 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ09106%27 HTTP/1.1" 200 None
2026-03-29 19:10:59 [auto1.nl] INFO: Scrape type for YZ09106: 2
2026-03-29 19:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 252e6800-64b5-5d19-be05-9a2a75035965 with identifier: YZ09106
2026-03-29 19:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 252e6800-64b5-5d19-be05-9a2a75035965 with scrape type 2
2026-03-29 19:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 252e6800-64b5-5d19-be05-9a2a75035965 with scrape type 2
2026-03-29 19:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 252e6800-64b5-5d19-be05-9a2a75035965, identifier: YZ09106
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-29 19:10:59 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-29 19:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-29 19:11:00 [auto1.nl] INFO: Scrape type for YE50957: 2
2026-03-29 19:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-29 19:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with scrape type 2
2026-03-29 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with scrape type 2
2026-03-29 19:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df, identifier: YE50957
2026-03-29 19:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 252e6800-64b5-5d19-be05-9a2a75035965 with identifier: YZ09106
2026-03-29 19:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 252e6800-64b5-5d19-be05-9a2a75035965 with identifier: YZ09106
2026-03-29 19:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 252e6800-64b5-5d19-be05-9a2a75035965 with identifier: YZ09106 to the API
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:00:09Z',
 'fuel_type': 'petrol',
 'id': '252e6800-64b5-5d19-be05-9a2a75035965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ09106',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'RCZ',
 'odometer': 107837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-04',
 'seller_name': None,
 'title': 'Peugeot RCZ 1.6 THP Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2013}
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ09106%27 HTTP/1.1" 200 None
2026-03-29 19:11:00 [auto1.nl] INFO: Saving data for YZ09106: {'auction_closing_time': 1774882809.0, 'created_time': 1774354487.033438, 'last_price_update_time': 1774811460.352156}
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ09106') HTTP/1.1" 204 0
2026-03-29 19:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-29 19:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-29 19:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957 to the API
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:58:17Z',
 'fuel_type': 'petrol',
 'id': '4c8de35b-ef90-5ef7-9bd4-77e49765b5df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE50957',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 136810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2019}
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-29 19:11:00 [auto1.nl] INFO: Saving data for YE50957: {'auction_closing_time': 1774886297.0, 'created_time': 1774613476.007134, 'last_price_update_time': 1774811460.66714}
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YE50957') HTTP/1.1" 204 0
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-29 19:11:00 [auto1.nl] INFO: Scrape type for GN89359: 0
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-29 19:11:00 [auto1.nl] INFO: Scrape type for NS14796: 2
2026-03-29 19:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-29 19:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74585280-636a-555d-bcd2-59b72e84a7f3 with scrape type 2
2026-03-29 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74585280-636a-555d-bcd2-59b72e84a7f3 with scrape type 2
2026-03-29 19:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74585280-636a-555d-bcd2-59b72e84a7f3, identifier: NS14796
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-29 19:11:00 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-29 19:11:00 [auto1.nl] INFO: Scrape type for YH72796: 2
2026-03-29 19:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-29 19:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57d93af0-67d8-55f9-ae0a-201b49f43387 with scrape type 2
2026-03-29 19:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57d93af0-67d8-55f9-ae0a-201b49f43387 with scrape type 2
2026-03-29 19:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 57d93af0-67d8-55f9-ae0a-201b49f43387, identifier: YH72796
2026-03-29 19:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-29 19:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-29 19:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796 to the API
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:23:10Z',
 'fuel_type': 'petrol',
 'id': '74585280-636a-555d-bcd2-59b72e84a7f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS14796',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 230910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-29 19:11:01 [auto1.nl] INFO: Saving data for NS14796: {'auction_closing_time': 1774884190.0, 'created_time': 1774527048.403402, 'last_price_update_time': 1774811461.164634}
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NS14796') HTTP/1.1" 204 0
2026-03-29 19:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-29 19:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-29 19:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796 to the API
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:52:51Z',
 'fuel_type': 'hybrid',
 'id': '57d93af0-67d8-55f9-ae0a-201b49f43387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH72796',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 208636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40e Lounge Plus',
 'transmission': 'automatic',
 'trim': 'Lounge Plus',
 'year': 2017}
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-29 19:11:01 [auto1.nl] INFO: Saving data for YH72796: {'auction_closing_time': 1774885971.0, 'created_time': 1773861304.855617, 'last_price_update_time': 1774811461.560949}
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YH72796') HTTP/1.1" 204 0
2026-03-29 19:11:01 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-29 19:11:01 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-29 19:11:01 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-29 19:11:01 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-29 19:11:01 [auto1.nl] INFO: Scrape type for JX11008: 2
2026-03-29 19:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-29 19:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8b9678-0d61-5def-8158-cc26e8801efd with scrape type 2
2026-03-29 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a8b9678-0d61-5def-8158-cc26e8801efd with scrape type 2
2026-03-29 19:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0a8b9678-0d61-5def-8158-cc26e8801efd, identifier: JX11008
2026-03-29 19:11:01 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-29 19:11:01 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-29 19:11:01 [auto1.nl] INFO: Scrape type for GG02103: 2
2026-03-29 19:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-29 19:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2408e1-db1c-55b2-9b47-89752902d7d2 with scrape type 2
2026-03-29 19:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e2408e1-db1c-55b2-9b47-89752902d7d2 with scrape type 2
2026-03-29 19:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4e2408e1-db1c-55b2-9b47-89752902d7d2, identifier: GG02103
2026-03-29 19:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-29 19:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-29 19:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008 to the API
2026-03-29 19:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:20Z',
 'fuel_type': 'petrol',
 'id': '0a8b9678-0d61-5def-8158-cc26e8801efd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX11008',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 93298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-29 19:11:02 [auto1.nl] INFO: Saving data for JX11008: {'auction_closing_time': 1774883840.0, 'created_time': 1773749658.91943, 'last_price_update_time': 1774811462.109398}
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JX11008') HTTP/1.1" 204 0
2026-03-29 19:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-29 19:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-29 19:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103 to the API
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:18:40Z',
 'fuel_type': 'petrol',
 'id': '4e2408e1-db1c-55b2-9b47-89752902d7d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG02103',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 181472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-29 19:11:02 [auto1.nl] INFO: Saving data for GG02103: {'auction_closing_time': 1774883920.0, 'created_time': 1774613432.791702, 'last_price_update_time': 1774811462.474147}
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GG02103') HTTP/1.1" 204 0
2026-03-29 19:11:02 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-29 19:11:02 [auto1.nl] INFO: Scrape type for VH01672: 2
2026-03-29 19:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-29 19:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with scrape type 2
2026-03-29 19:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with scrape type 2
2026-03-29 19:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6db109cc-5fc8-5053-8d59-6ac44de9ef03, identifier: VH01672
2026-03-29 19:11:02 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-29 19:11:02 [auto1.nl] INFO: Scrape type for NB25760: 0
2026-03-29 19:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-29 19:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672
2026-03-29 19:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6db109cc-5fc8-5053-8d59-6ac44de9ef03 with identifier: VH01672 to the API
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:41:43Z',
 'fuel_type': 'hybrid',
 'id': '6db109cc-5fc8-5053-8d59-6ac44de9ef03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH01672',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 226716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2015}
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-29 19:11:02 [auto1.nl] INFO: Saving data for VH01672: {'auction_closing_time': 1774885303.0, 'created_time': 1773837490.962907, 'last_price_update_time': 1774811462.875428}
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH01672') HTTP/1.1" 204 0
2026-03-29 19:11:02 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-29 19:11:02 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-29 19:11:02 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-29 19:11:02 [auto1.nl] INFO: Scrape type for MW03156: 2
2026-03-29 19:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-29 19:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with scrape type 2
2026-03-29 19:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with scrape type 2
2026-03-29 19:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 42fb4e30-a8ac-5e51-9b32-a0d25768c890, identifier: MW03156
2026-03-29 19:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-29 19:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-29 19:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156 to the API
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:07:42Z',
 'fuel_type': 'petrol',
 'id': '42fb4e30-a8ac-5e51-9b32-a0d25768c890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW03156',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 163375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-29',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2004}
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-29 19:11:03 [auto1.nl] INFO: Saving data for MW03156: {'auction_closing_time': 1774883262.0, 'created_time': 1774095097.615821, 'last_price_update_time': 1774811463.30755}
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW03156') HTTP/1.1" 204 0
2026-03-29 19:11:03 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ58386%27 HTTP/1.1" 200 None
2026-03-29 19:11:03 [auto1.nl] INFO: Scrape type for HJ58386: 2
2026-03-29 19:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee954f56-154d-5a4c-8e68-31e185dc9533 with identifier: HJ58386
2026-03-29 19:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee954f56-154d-5a4c-8e68-31e185dc9533 with scrape type 2
2026-03-29 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee954f56-154d-5a4c-8e68-31e185dc9533 with scrape type 2
2026-03-29 19:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ee954f56-154d-5a4c-8e68-31e185dc9533, identifier: HJ58386
2026-03-29 19:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ee954f56-154d-5a4c-8e68-31e185dc9533 with identifier: HJ58386
2026-03-29 19:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ee954f56-154d-5a4c-8e68-31e185dc9533 with identifier: HJ58386
2026-03-29 19:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ee954f56-154d-5a4c-8e68-31e185dc9533 with identifier: HJ58386 to the API
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:20Z',
 'fuel_type': 'petrol',
 'id': 'ee954f56-154d-5a4c-8e68-31e185dc9533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ58386',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 293692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-25',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ58386%27 HTTP/1.1" 200 None
2026-03-29 19:11:03 [auto1.nl] INFO: Saving data for HJ58386: {'auction_closing_time': 1774885100.0, 'created_time': 1774725060.520572, 'last_price_update_time': 1774811463.676089}
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HJ58386') HTTP/1.1" 204 0
2026-03-29 19:11:03 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-29 19:11:03 [auto1.nl] INFO: Scrape type for VR09113: 2
2026-03-29 19:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-29 19:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04fa97e3-66df-50cc-9db9-719167ae7290 with scrape type 2
2026-03-29 19:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04fa97e3-66df-50cc-9db9-719167ae7290 with scrape type 2
2026-03-29 19:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04fa97e3-66df-50cc-9db9-719167ae7290, identifier: VR09113
2026-03-29 19:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-29 19:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-29 19:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113 to the API
2026-03-29 19:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:23:09Z',
 'fuel_type': 'petrol',
 'id': '04fa97e3-66df-50cc-9db9-719167ae7290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR09113',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 75392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2016}
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-29 19:11:04 [auto1.nl] INFO: Saving data for VR09113: {'auction_closing_time': 1774884189.0, 'created_time': 1774613475.668072, 'last_price_update_time': 1774811464.195983}
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VR09113') HTTP/1.1" 204 0
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-29 19:11:04 [auto1.nl] INFO: Scrape type for KD36085: 0
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-29 19:11:04 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-29 19:11:04 [auto1.nl] INFO: Scrape type for YN37403: 2
2026-03-29 19:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-29 19:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73656187-f35a-5ed4-b942-7a3c94b60356 with scrape type 2
2026-03-29 19:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73656187-f35a-5ed4-b942-7a3c94b60356 with scrape type 2
2026-03-29 19:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 73656187-f35a-5ed4-b942-7a3c94b60356, identifier: YN37403
2026-03-29 19:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-29 19:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-29 19:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403 to the API
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:52:52Z',
 'fuel_type': 'petrol',
 'id': '73656187-f35a-5ed4-b942-7a3c94b60356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN37403',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 155561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2015}
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-29 19:11:04 [auto1.nl] INFO: Saving data for YN37403: {'auction_closing_time': 1774885972.0, 'created_time': 1773688652.373443, 'last_price_update_time': 1774811464.638678}
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN37403') HTTP/1.1" 204 0
2026-03-29 19:11:04 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 758 | hits on page: 40
2026-03-29 19:11:04 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-29 19:11:04 [auto1.nl] INFO: Scrape type for FE21861: 2
2026-03-29 19:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-29 19:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with scrape type 2
2026-03-29 19:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with scrape type 2
2026-03-29 19:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055, identifier: FE21861
2026-03-29 19:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-29 19:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-29 19:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861 to the API
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:38:35Z',
 'fuel_type': 'hybrid',
 'id': '1ed2ca5e-b39d-52ec-811e-1f4acb82e055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE21861',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 149076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seller_name': None,
 'title': 'BMW 5er 530e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-29 19:11:05 [auto1.nl] INFO: Saving data for FE21861: {'auction_closing_time': 1774885115.0, 'created_time': 1773774764.56175, 'last_price_update_time': 1774811465.058567}
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE21861') HTTP/1.1" 204 0
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-29 19:11:05 [auto1.nl] INFO: Scrape type for FK39304: 2
2026-03-29 19:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-29 19:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaeb7602-4138-550e-88fa-de8627c49056 with scrape type 2
2026-03-29 19:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaeb7602-4138-550e-88fa-de8627c49056 with scrape type 2
2026-03-29 19:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aaeb7602-4138-550e-88fa-de8627c49056, identifier: FK39304
2026-03-29 19:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-29 19:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-29 19:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304 to the API
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:51:29Z',
 'fuel_type': 'petrol',
 'id': 'aaeb7602-4138-550e-88fa-de8627c49056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK39304',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 82466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-15',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-29 19:11:05 [auto1.nl] INFO: Saving data for FK39304: {'auction_closing_time': 1774885889.0, 'created_time': 1774613444.282703, 'last_price_update_time': 1774811465.580744}
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK39304') HTTP/1.1" 204 0
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-29 19:11:05 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-29 19:11:05 [auto1.nl] INFO: Scrape type for PY93062: 0
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-29 19:11:05 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-29 19:11:05 [auto1.nl] INFO: Scrape type for PY55457: 2
2026-03-29 19:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-29 19:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with scrape type 2
2026-03-29 19:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with scrape type 2
2026-03-29 19:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2, identifier: PY55457
2026-03-29 19:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-29 19:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-29 19:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457 to the API
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:55:04Z',
 'fuel_type': 'petrol',
 'id': 'f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY55457',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 208379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-05',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-29 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-29 19:11:06 [auto1.nl] INFO: Saving data for PY55457: {'auction_closing_time': 1774886104.0, 'created_time': 1774613459.460172, 'last_price_update_time': 1774811466.055336}
2026-03-29 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY55457') HTTP/1.1" 204 0
2026-03-29 19:11:06 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-29 19:11:06 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-29 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-29 19:11:06 [auto1.nl] INFO: Scrape type for CL54405: 2
2026-03-29 19:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-29 19:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915b7680-b624-52f2-b4e5-980f554a89e1 with scrape type 2
2026-03-29 19:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 915b7680-b624-52f2-b4e5-980f554a89e1 with scrape type 2
2026-03-29 19:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 915b7680-b624-52f2-b4e5-980f554a89e1, identifier: CL54405
2026-03-29 19:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-29 19:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-29 19:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405 to the API
2026-03-29 19:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:50:12Z',
 'fuel_type': 'petrol',
 'id': '915b7680-b624-52f2-b4e5-980f554a89e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL54405',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 240816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-09',
 'seller_name': None,
 'title': 'Kia Soul 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-29 19:11:07 [auto1.nl] INFO: Saving data for CL54405: {'auction_closing_time': 1774885812.0, 'created_time': 1774527043.567237, 'last_price_update_time': 1774811467.346089}
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CL54405') HTTP/1.1" 204 0
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-29 19:11:07 [auto1.nl] INFO: Scrape type for AJ38016: 0
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-29 19:11:07 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-29 19:11:07 [auto1.nl] INFO: Scrape type for RJ32742: 0
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-29 19:11:07 [auto1.nl] INFO: Scrape type for MD45251: 2
2026-03-29 19:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-29 19:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666aa210-f426-54cd-a1d4-3adb8819bfed with scrape type 2
2026-03-29 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 666aa210-f426-54cd-a1d4-3adb8819bfed with scrape type 2
2026-03-29 19:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 666aa210-f426-54cd-a1d4-3adb8819bfed, identifier: MD45251
2026-03-29 19:11:07 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 16 pages/min), scraped 82 items (at 82 items/min)
2026-03-29 19:11:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-29 19:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-29 19:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-29 19:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251 to the API
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:23:29Z',
 'fuel_type': 'petrol',
 'id': '666aa210-f426-54cd-a1d4-3adb8819bfed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD45251',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 114858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2015}
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-29 19:11:07 [auto1.nl] INFO: Saving data for MD45251: {'auction_closing_time': 1774884209.0, 'created_time': 1774613492.552532, 'last_price_update_time': 1774811467.91484}
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD45251') HTTP/1.1" 204 0
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-29 19:11:07 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-29 19:11:07 [auto1.nl] INFO: Scrape type for EJ39658: 2
2026-03-29 19:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-29 19:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0012bf-5658-5926-af3a-c3b123cb3af9 with scrape type 2
2026-03-29 19:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec0012bf-5658-5926-af3a-c3b123cb3af9 with scrape type 2
2026-03-29 19:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ec0012bf-5658-5926-af3a-c3b123cb3af9, identifier: EJ39658
2026-03-29 19:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-29 19:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-29 19:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658 to the API
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:37:30Z',
 'fuel_type': 'petrol',
 'id': 'ec0012bf-5658-5926-af3a-c3b123cb3af9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ39658',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 146441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-29 19:11:08 [auto1.nl] INFO: Saving data for EJ39658: {'auction_closing_time': 1774885050.0, 'created_time': 1774527119.559923, 'last_price_update_time': 1774811468.30871}
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ39658') HTTP/1.1" 204 0
2026-03-29 19:11:08 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-29 19:11:08 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-29 19:11:08 [auto1.nl] INFO: Scrape type for ME20407: 2
2026-03-29 19:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-29 19:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add5493e-b129-5b80-afd7-0ec6d0d838c9 with scrape type 2
2026-03-29 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item add5493e-b129-5b80-afd7-0ec6d0d838c9 with scrape type 2
2026-03-29 19:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: add5493e-b129-5b80-afd7-0ec6d0d838c9, identifier: ME20407
2026-03-29 19:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-29 19:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407
2026-03-29 19:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: add5493e-b129-5b80-afd7-0ec6d0d838c9 with identifier: ME20407 to the API
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:27:36Z',
 'fuel_type': 'hybrid',
 'id': 'add5493e-b129-5b80-afd7-0ec6d0d838c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME20407',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 57060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-04',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2022}
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-29 19:11:08 [auto1.nl] INFO: Saving data for ME20407: {'auction_closing_time': 1774884456.0, 'created_time': 1774638641.528342, 'last_price_update_time': 1774811468.725438}
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME20407') HTTP/1.1" 204 0
2026-03-29 19:11:08 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-29 19:11:08 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-29 19:11:08 [auto1.nl] INFO: Scrape type for LG71332: 2
2026-03-29 19:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-29 19:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with scrape type 2
2026-03-29 19:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with scrape type 2
2026-03-29 19:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d, identifier: LG71332
2026-03-29 19:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-29 19:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332
2026-03-29 19:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d with identifier: LG71332 to the API
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:43:53Z',
 'fuel_type': 'petrol',
 'id': '9bccc0a1-d4c8-5ebd-9b3c-0fa2bd078b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG71332',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 152911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-08',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-29 19:11:09 [auto1.nl] INFO: Saving data for LG71332: {'auction_closing_time': 1774885433.0, 'created_time': 1774638644.173485, 'last_price_update_time': 1774811469.203417}
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG71332') HTTP/1.1" 204 0
2026-03-29 19:11:09 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-29 19:11:09 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF49809%27 HTTP/1.1" 200 None
2026-03-29 19:11:09 [auto1.nl] INFO: Scrape type for KF49809: 2
2026-03-29 19:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c0a7dc-681d-584d-9516-17310bee504a with identifier: KF49809
2026-03-29 19:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c0a7dc-681d-584d-9516-17310bee504a with scrape type 2
2026-03-29 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94c0a7dc-681d-584d-9516-17310bee504a with scrape type 2
2026-03-29 19:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 94c0a7dc-681d-584d-9516-17310bee504a, identifier: KF49809
2026-03-29 19:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 94c0a7dc-681d-584d-9516-17310bee504a with identifier: KF49809
2026-03-29 19:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 94c0a7dc-681d-584d-9516-17310bee504a with identifier: KF49809
2026-03-29 19:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 94c0a7dc-681d-584d-9516-17310bee504a with identifier: KF49809 to the API
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'diesel',
 'id': '94c0a7dc-681d-584d-9516-17310bee504a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF49809',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 268876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-07',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2014}
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF49809%27 HTTP/1.1" 200 None
2026-03-29 19:11:09 [auto1.nl] INFO: Saving data for KF49809: {'auction_closing_time': 1774884566.0, 'created_time': 1774725064.26509, 'last_price_update_time': 1774811469.573382}
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KF49809') HTTP/1.1" 204 0
2026-03-29 19:11:09 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-29 19:11:09 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-29 19:11:09 [auto1.nl] INFO: Scrape type for AM07460: 0
2026-03-29 19:11:09 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-29 19:11:09 [auto1.nl] INFO: Scrape type for CP77095: 2
2026-03-29 19:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-29 19:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40f25db6-ecfa-58fb-937a-bac29060adc3 with scrape type 2
2026-03-29 19:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40f25db6-ecfa-58fb-937a-bac29060adc3 with scrape type 2
2026-03-29 19:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40f25db6-ecfa-58fb-937a-bac29060adc3, identifier: CP77095
2026-03-29 19:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-29 19:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-29 19:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095 to the API
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:28:51Z',
 'fuel_type': 'petrol',
 'id': '40f25db6-ecfa-58fb-937a-bac29060adc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP77095',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 36765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2020}
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-29 19:11:10 [auto1.nl] INFO: Saving data for CP77095: {'auction_closing_time': 1774884531.0, 'created_time': 1774613425.507735, 'last_price_update_time': 1774811470.076854}
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP77095') HTTP/1.1" 204 0
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-29 19:11:10 [auto1.nl] INFO: Scrape type for FC64695: 2
2026-03-29 19:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-29 19:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b440c16f-9729-50c4-b006-0c0325ae9f89 with scrape type 2
2026-03-29 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b440c16f-9729-50c4-b006-0c0325ae9f89 with scrape type 2
2026-03-29 19:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b440c16f-9729-50c4-b006-0c0325ae9f89, identifier: FC64695
2026-03-29 19:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-29 19:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-29 19:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695 to the API
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:40:35Z',
 'fuel_type': 'petrol',
 'id': 'b440c16f-9729-50c4-b006-0c0325ae9f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC64695',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 185857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-16',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-29 19:11:10 [auto1.nl] INFO: Saving data for FC64695: {'auction_closing_time': 1774885235.0, 'created_time': 1774613450.447302, 'last_price_update_time': 1774811470.492741}
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FC64695') HTTP/1.1" 204 0
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE91435%27 HTTP/1.1" 200 None
2026-03-29 19:11:10 [auto1.nl] INFO: Scrape type for FE91435: 2
2026-03-29 19:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189cafac-7b7a-5c46-850d-5c7206df413d with identifier: FE91435
2026-03-29 19:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189cafac-7b7a-5c46-850d-5c7206df413d with scrape type 2
2026-03-29 19:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189cafac-7b7a-5c46-850d-5c7206df413d with scrape type 2
2026-03-29 19:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 189cafac-7b7a-5c46-850d-5c7206df413d, identifier: FE91435
2026-03-29 19:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 189cafac-7b7a-5c46-850d-5c7206df413d with identifier: FE91435
2026-03-29 19:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 189cafac-7b7a-5c46-850d-5c7206df413d with identifier: FE91435
2026-03-29 19:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 189cafac-7b7a-5c46-850d-5c7206df413d with identifier: FE91435 to the API
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:18:01Z',
 'fuel_type': 'petrol',
 'id': '189cafac-7b7a-5c46-850d-5c7206df413d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE91435',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 115000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Business Elegance Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Elegance Start/Stop',
 'year': 2021}
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE91435%27 HTTP/1.1" 200 None
2026-03-29 19:11:10 [auto1.nl] INFO: Saving data for FE91435: {'auction_closing_time': 1774883881.0, 'created_time': 1773344054.42304, 'last_price_update_time': 1774811470.88138}
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE91435') HTTP/1.1" 204 0
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-29 19:11:10 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 758 | hits on page: 40
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-29 19:11:10 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-29 19:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-29 19:11:11 [auto1.nl] INFO: Scrape type for TC15988: 2
2026-03-29 19:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-29 19:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd61cbb9-f227-5599-9f83-2942b52c0271 with scrape type 2
2026-03-29 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd61cbb9-f227-5599-9f83-2942b52c0271 with scrape type 2
2026-03-29 19:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd61cbb9-f227-5599-9f83-2942b52c0271, identifier: TC15988
2026-03-29 19:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-29 19:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-29 19:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988 to the API
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:46:57Z',
 'fuel_type': 'hybrid',
 'id': 'cd61cbb9-f227-5599-9f83-2942b52c0271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC15988',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 129745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-30',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-29 19:11:11 [auto1.nl] INFO: Saving data for TC15988: {'auction_closing_time': 1774885617.0, 'created_time': 1774613438.55577, 'last_price_update_time': 1774811471.409479}
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC15988') HTTP/1.1" 204 0
2026-03-29 19:11:11 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-29 19:11:11 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-29 19:11:11 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-29 19:11:11 [auto1.nl] INFO: Scrape type for WJ55319: 2
2026-03-29 19:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-29 19:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with scrape type 2
2026-03-29 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with scrape type 2
2026-03-29 19:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f, identifier: WJ55319
2026-03-29 19:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-29 19:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-29 19:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319 to the API
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:12:15Z',
 'fuel_type': 'petrol',
 'id': '1e9ea7c4-5e26-5b98-96d5-dfd26e22978f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ55319',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 222302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2013}
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-29 19:11:11 [auto1.nl] INFO: Saving data for WJ55319: {'auction_closing_time': 1774883535.0, 'created_time': 1774527077.070313, 'last_price_update_time': 1774811471.779975}
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WJ55319') HTTP/1.1" 204 0
2026-03-29 19:11:11 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-29 19:11:11 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-29 19:11:11 [auto1.nl] INFO: Scrape type for HK90585: 2
2026-03-29 19:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-29 19:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14de2679-1d2d-5a57-997b-0f391724915e with scrape type 2
2026-03-29 19:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14de2679-1d2d-5a57-997b-0f391724915e with scrape type 2
2026-03-29 19:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14de2679-1d2d-5a57-997b-0f391724915e, identifier: HK90585
2026-03-29 19:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-29 19:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-29 19:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585 to the API
2026-03-29 19:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:41Z',
 'fuel_type': 'diesel',
 'id': '14de2679-1d2d-5a57-997b-0f391724915e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK90585',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 194876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-29 19:11:12 [auto1.nl] INFO: Saving data for HK90585: {'auction_closing_time': 1774885841.0, 'created_time': 1774293136.267029, 'last_price_update_time': 1774811472.209171}
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK90585') HTTP/1.1" 204 0
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB20368%27 HTTP/1.1" 200 None
2026-03-29 19:11:12 [auto1.nl] INFO: Scrape type for FB20368: 2
2026-03-29 19:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with identifier: FB20368
2026-03-29 19:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with scrape type 2
2026-03-29 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with scrape type 2
2026-03-29 19:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1, identifier: FB20368
2026-03-29 19:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with identifier: FB20368
2026-03-29 19:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with identifier: FB20368
2026-03-29 19:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad59ec4a-db09-5632-a5c5-d29ccd21a6b1 with identifier: FB20368 to the API
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:33Z',
 'fuel_type': 'diesel',
 'id': 'ad59ec4a-db09-5632-a5c5-d29ccd21a6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB20368',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 277082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB20368%27 HTTP/1.1" 200 None
2026-03-29 19:11:12 [auto1.nl] INFO: Saving data for FB20368: {'auction_closing_time': 1774884573.0, 'created_time': 1773861219.747487, 'last_price_update_time': 1774811472.690819}
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB20368') HTTP/1.1" 204 0
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-29 19:11:12 [auto1.nl] INFO: Scrape type for CT01963: 0
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-29 19:11:12 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-29 19:11:12 [auto1.nl] INFO: Scrape type for VB13156: 2
2026-03-29 19:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-29 19:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with scrape type 2
2026-03-29 19:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with scrape type 2
2026-03-29 19:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c, identifier: VB13156
2026-03-29 19:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-29 19:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-29 19:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156 to the API
2026-03-29 19:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:03Z',
 'fuel_type': 'petrol',
 'id': 'ea329a1a-3c4c-5d10-8e9e-ab41d502d10c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB13156',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 157239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-29 19:11:13 [auto1.nl] INFO: Saving data for VB13156: {'auction_closing_time': 1774885863.0, 'created_time': 1774527084.011915, 'last_price_update_time': 1774811473.126033}
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VB13156') HTTP/1.1" 204 0
2026-03-29 19:11:13 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-29 19:11:13 [auto1.nl] INFO: Scrape type for PN82428: 0
2026-03-29 19:11:13 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-29 19:11:13 [auto1.nl] INFO: Scrape type for EB00697: 2
2026-03-29 19:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-29 19:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b36c08-995b-57ef-acbe-81463121f442 with scrape type 2
2026-03-29 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5b36c08-995b-57ef-acbe-81463121f442 with scrape type 2
2026-03-29 19:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b5b36c08-995b-57ef-acbe-81463121f442, identifier: EB00697
2026-03-29 19:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-29 19:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-29 19:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697 to the API
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 430,
 'expiration_date': '2026-03-30T15:22:12Z',
 'fuel_type': 'petrol',
 'id': 'b5b36c08-995b-57ef-acbe-81463121f442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB00697',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 122496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-02',
 'seller_name': None,
 'title': 'Porsche Panamera GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-29 19:11:13 [auto1.nl] INFO: Saving data for EB00697: {'auction_closing_time': 1774884132.0, 'created_time': 1774613480.339282, 'last_price_update_time': 1774811473.636106}
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB00697') HTTP/1.1" 204 0
2026-03-29 19:11:13 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-29 19:11:13 [auto1.nl] INFO: Scrape type for YR49127: 0
2026-03-29 19:11:13 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-29 19:11:13 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-29 19:11:13 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-29 19:11:13 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-29 19:11:13 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-29 19:11:13 [auto1.nl] INFO: Scrape type for WC97739: 2
2026-03-29 19:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-29 19:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f26a86-04a1-54ac-847d-87305f01649e with scrape type 2
2026-03-29 19:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f26a86-04a1-54ac-847d-87305f01649e with scrape type 2
2026-03-29 19:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96f26a86-04a1-54ac-847d-87305f01649e, identifier: WC97739
2026-03-29 19:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-29 19:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-29 19:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739 to the API
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:31:15Z',
 'fuel_type': 'petrol',
 'id': '96f26a86-04a1-54ac-847d-87305f01649e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC97739',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 123196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-29 19:11:14 [auto1.nl] INFO: Saving data for WC97739: {'auction_closing_time': 1774884675.0, 'created_time': 1774527070.82757, 'last_price_update_time': 1774811474.107149}
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC97739') HTTP/1.1" 204 0
2026-03-29 19:11:14 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-29 19:11:14 [auto1.nl] INFO: Scrape type for BP06390: 2
2026-03-29 19:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-29 19:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a060f5-5277-5051-b7fb-71f560fa26d1 with scrape type 2
2026-03-29 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08a060f5-5277-5051-b7fb-71f560fa26d1 with scrape type 2
2026-03-29 19:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08a060f5-5277-5051-b7fb-71f560fa26d1, identifier: BP06390
2026-03-29 19:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-29 19:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-29 19:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390 to the API
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:37:58Z',
 'fuel_type': 'petrol',
 'id': '08a060f5-5277-5051-b7fb-71f560fa26d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP06390',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 135881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-29 19:11:14 [auto1.nl] INFO: Saving data for BP06390: {'auction_closing_time': 1774885078.0, 'created_time': 1773688304.691821, 'last_price_update_time': 1774811474.558333}
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP06390') HTTP/1.1" 204 0
2026-03-29 19:11:14 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-29 19:11:14 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-29 19:11:14 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-29 19:11:14 [auto1.nl] INFO: Scrape type for VB96147: 2
2026-03-29 19:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-29 19:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with scrape type 2
2026-03-29 19:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with scrape type 2
2026-03-29 19:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2, identifier: VB96147
2026-03-29 19:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-29 19:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-29 19:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147 to the API
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:47Z',
 'fuel_type': 'petrol',
 'id': '155d186a-c2a1-57fd-8f5b-08aefda5e6e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB96147',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 200922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-02',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-29 19:11:14 [auto1.nl] INFO: Saving data for VB96147: {'auction_closing_time': 1774884227.0, 'created_time': 1774613431.46133, 'last_price_update_time': 1774811474.985976}
2026-03-29 19:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VB96147') HTTP/1.1" 204 0
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-29 19:11:15 [auto1.nl] INFO: Scrape type for DW43709: 2
2026-03-29 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-29 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 366e2ea1-0eee-5832-a306-aeed007a1b55 with scrape type 2
2026-03-29 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 366e2ea1-0eee-5832-a306-aeed007a1b55 with scrape type 2
2026-03-29 19:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 366e2ea1-0eee-5832-a306-aeed007a1b55, identifier: DW43709
2026-03-29 19:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-29 19:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-29 19:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709 to the API
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:09Z',
 'fuel_type': 'petrol',
 'id': '366e2ea1-0eee-5832-a306-aeed007a1b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW43709',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 80671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2017}
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-29 19:11:15 [auto1.nl] INFO: Saving data for DW43709: {'auction_closing_time': 1774883709.0, 'created_time': 1774527075.124354, 'last_price_update_time': 1774811475.493751}
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW43709') HTTP/1.1" 204 0
2026-03-29 19:11:15 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 758 | hits on page: 40
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-29 19:11:15 [auto1.nl] INFO: Scrape type for SM08260: 0
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-29 19:11:15 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-29 19:11:15 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-29 19:11:15 [auto1.nl] INFO: Scrape type for AB34968: 2
2026-03-29 19:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-29 19:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with scrape type 2
2026-03-29 19:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with scrape type 2
2026-03-29 19:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1466d57b-48fb-5f7c-bf02-89823f4e64b8, identifier: AB34968
2026-03-29 19:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-29 19:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-29 19:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968 to the API
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:17:43Z',
 'fuel_type': 'petrol',
 'id': '1466d57b-48fb-5f7c-bf02-89823f4e64b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB34968',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 211460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-29 19:11:15 [auto1.nl] INFO: Saving data for AB34968: {'auction_closing_time': 1774883863.0, 'created_time': 1774613435.096347, 'last_price_update_time': 1774811475.965598}
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB34968') HTTP/1.1" 204 0
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-29 19:11:16 [auto1.nl] INFO: Scrape type for WE00434: 0
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-29 19:11:16 [auto1.nl] INFO: Scrape type for SZ87293: 0
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-29 19:11:16 [auto1.nl] INFO: Scrape type for SY05694: 2
2026-03-29 19:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-29 19:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c97aa07e-16f6-5199-bab2-4ee85e79a62e with scrape type 2
2026-03-29 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c97aa07e-16f6-5199-bab2-4ee85e79a62e with scrape type 2
2026-03-29 19:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c97aa07e-16f6-5199-bab2-4ee85e79a62e, identifier: SY05694
2026-03-29 19:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-29 19:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-29 19:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694 to the API
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:20:22Z',
 'fuel_type': 'petrol',
 'id': 'c97aa07e-16f6-5199-bab2-4ee85e79a62e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY05694',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 84161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2016}
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-29 19:11:16 [auto1.nl] INFO: Saving data for SY05694: {'auction_closing_time': 1774884022.0, 'created_time': 1774379539.06068, 'last_price_update_time': 1774811476.529775}
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY05694') HTTP/1.1" 204 0
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-29 19:11:16 [auto1.nl] INFO: Scrape type for GL61326: 2
2026-03-29 19:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-29 19:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536b061a-4d1f-52ff-bc34-542fbd256f0d with scrape type 2
2026-03-29 19:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 536b061a-4d1f-52ff-bc34-542fbd256f0d with scrape type 2
2026-03-29 19:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 536b061a-4d1f-52ff-bc34-542fbd256f0d, identifier: GL61326
2026-03-29 19:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-29 19:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-29 19:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326 to the API
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:56:02Z',
 'fuel_type': 'diesel',
 'id': '536b061a-4d1f-52ff-bc34-542fbd256f0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL61326',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 262671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-07',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-29 19:11:16 [auto1.nl] INFO: Saving data for GL61326: {'auction_closing_time': 1774886162.0, 'created_time': 1774613484.779007, 'last_price_update_time': 1774811476.968091}
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GL61326') HTTP/1.1" 204 0
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-29 19:11:16 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-29 19:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-29 19:11:17 [auto1.nl] INFO: Scrape type for YB51800: 2
2026-03-29 19:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-29 19:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with scrape type 2
2026-03-29 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with scrape type 2
2026-03-29 19:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7ff8dcd-66f0-506a-bdae-d97b95d3b837, identifier: YB51800
2026-03-29 19:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-29 19:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-29 19:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800 to the API
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:02:52Z',
 'fuel_type': 'petrol',
 'id': 'e7ff8dcd-66f0-506a-bdae-d97b95d3b837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB51800',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 197308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-28',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-29 19:11:17 [auto1.nl] INFO: Saving data for YB51800: {'auction_closing_time': 1774882972.0, 'created_time': 1773515440.741206, 'last_price_update_time': 1774811477.400091}
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB51800') HTTP/1.1" 204 0
2026-03-29 19:11:17 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-29 19:11:17 [auto1.nl] INFO: Scrape type for TP84646: 0
2026-03-29 19:11:17 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-29 19:11:17 [auto1.nl] INFO: Scrape type for UF96545: 2
2026-03-29 19:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-29 19:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1191053-835c-5ec0-bcdc-3ddbaf91671e with scrape type 2
2026-03-29 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1191053-835c-5ec0-bcdc-3ddbaf91671e with scrape type 2
2026-03-29 19:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1191053-835c-5ec0-bcdc-3ddbaf91671e, identifier: UF96545
2026-03-29 19:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-29 19:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-29 19:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545 to the API
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:59:21Z',
 'fuel_type': 'petrol',
 'id': 'f1191053-835c-5ec0-bcdc-3ddbaf91671e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF96545',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 179029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2017}
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-29 19:11:17 [auto1.nl] INFO: Saving data for UF96545: {'auction_closing_time': 1774886361.0, 'created_time': 1774613483.970692, 'last_price_update_time': 1774811477.827743}
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF96545') HTTP/1.1" 204 0
2026-03-29 19:11:17 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-29 19:11:17 [auto1.nl] INFO: Scrape type for EY58020: 0
2026-03-29 19:11:17 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-29 19:11:17 [auto1.nl] INFO: Scrape type for SG32295: 2
2026-03-29 19:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-29 19:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a15bdf39-e115-550b-ae6a-5b61e2f7917b with scrape type 2
2026-03-29 19:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a15bdf39-e115-550b-ae6a-5b61e2f7917b with scrape type 2
2026-03-29 19:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a15bdf39-e115-550b-ae6a-5b61e2f7917b, identifier: SG32295
2026-03-29 19:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-29 19:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-29 19:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295 to the API
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:42:35Z',
 'fuel_type': 'diesel',
 'id': 'a15bdf39-e115-550b-ae6a-5b61e2f7917b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG32295',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 256398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2010}
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-29 19:11:18 [auto1.nl] INFO: Saving data for SG32295: {'auction_closing_time': 1774885355.0, 'created_time': 1774527073.68788, 'last_price_update_time': 1774811478.333709}
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG32295') HTTP/1.1" 204 0
2026-03-29 19:11:18 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-29 19:11:18 [auto1.nl] INFO: Scrape type for TJ11018: 0
2026-03-29 19:11:18 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-29 19:11:18 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-29 19:11:18 [auto1.nl] INFO: Scrape type for WY03082: 2
2026-03-29 19:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-29 19:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90dc9897-29a0-5e78-b13e-74b15d6316b1 with scrape type 2
2026-03-29 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90dc9897-29a0-5e78-b13e-74b15d6316b1 with scrape type 2
2026-03-29 19:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 90dc9897-29a0-5e78-b13e-74b15d6316b1, identifier: WY03082
2026-03-29 19:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-29 19:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-29 19:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082 to the API
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:23:44Z',
 'fuel_type': 'diesel',
 'id': '90dc9897-29a0-5e78-b13e-74b15d6316b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY03082',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 170374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-14',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2015}
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-29 19:11:18 [auto1.nl] INFO: Saving data for WY03082: {'auction_closing_time': 1774884224.0, 'created_time': 1774613486.038029, 'last_price_update_time': 1774811478.758164}
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY03082') HTTP/1.1" 204 0
2026-03-29 19:11:18 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-29 19:11:18 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-29 19:11:18 [auto1.nl] INFO: Scrape type for EU67961: 2
2026-03-29 19:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-29 19:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74959324-1a2f-505c-96c1-7657c4c75a9f with scrape type 2
2026-03-29 19:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74959324-1a2f-505c-96c1-7657c4c75a9f with scrape type 2
2026-03-29 19:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74959324-1a2f-505c-96c1-7657c4c75a9f, identifier: EU67961
2026-03-29 19:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-29 19:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-29 19:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961 to the API
2026-03-29 19:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:55Z',
 'fuel_type': 'petrol',
 'id': '74959324-1a2f-505c-96c1-7657c4c75a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU67961',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 186342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-29 19:11:19 [auto1.nl] INFO: Saving data for EU67961: {'auction_closing_time': 1774885135.0, 'created_time': 1773688317.813995, 'last_price_update_time': 1774811479.174908}
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EU67961') HTTP/1.1" 204 0
2026-03-29 19:11:19 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-29 19:11:19 [auto1.nl] INFO: Scrape type for FA26024: 0
2026-03-29 19:11:19 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-29 19:11:19 [auto1.nl] INFO: Scrape type for TH29476: 2
2026-03-29 19:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-29 19:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with scrape type 2
2026-03-29 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with scrape type 2
2026-03-29 19:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4, identifier: TH29476
2026-03-29 19:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-29 19:11:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-29 19:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476 to the API
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:58:47Z',
 'fuel_type': 'electro',
 'id': '46b19869-6a66-5fe2-9ed7-a7e0960a78b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH29476',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 163460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seller_name': None,
 'title': 'Kia EV6 electric drive 239 kW GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2022}
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-29 19:11:19 [auto1.nl] INFO: Saving data for TH29476: {'auction_closing_time': 1774886327.0, 'created_time': 1773947569.529077, 'last_price_update_time': 1774811479.778143}
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TH29476') HTTP/1.1" 204 0
2026-03-29 19:11:19 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-29 19:11:19 [auto1.nl] INFO: Scrape type for TU99712: 2
2026-03-29 19:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-29 19:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96456424-0567-5400-a6a2-f9b54836aa7f with scrape type 2
2026-03-29 19:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96456424-0567-5400-a6a2-f9b54836aa7f with scrape type 2
2026-03-29 19:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96456424-0567-5400-a6a2-f9b54836aa7f, identifier: TU99712
2026-03-29 19:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-29 19:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712
2026-03-29 19:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96456424-0567-5400-a6a2-f9b54836aa7f with identifier: TU99712 to the API
2026-03-29 19:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:24:43Z',
 'fuel_type': 'petrol',
 'id': '96456424-0567-5400-a6a2-f9b54836aa7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU99712',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 65577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'BMW 3er 330i GT xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2017}
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-29 19:11:20 [auto1.nl] INFO: Saving data for TU99712: {'auction_closing_time': 1774884283.0, 'created_time': 1774638635.201322, 'last_price_update_time': 1774811480.160341}
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU99712') HTTP/1.1" 204 0
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-29 19:11:20 [auto1.nl] INFO: Scrape type for BX66014: 2
2026-03-29 19:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-29 19:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c90c6f-46d6-5f66-901c-63a9880b940f with scrape type 2
2026-03-29 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02c90c6f-46d6-5f66-901c-63a9880b940f with scrape type 2
2026-03-29 19:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02c90c6f-46d6-5f66-901c-63a9880b940f, identifier: BX66014
2026-03-29 19:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-29 19:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014
2026-03-29 19:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02c90c6f-46d6-5f66-901c-63a9880b940f with identifier: BX66014 to the API
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:26:41Z',
 'fuel_type': 'hybrid',
 'id': '02c90c6f-46d6-5f66-901c-63a9880b940f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX66014',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 217631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-22',
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h E-Four',
 'transmission': 'automatic',
 'trim': 'E-Four',
 'year': 2014}
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-29 19:11:20 [auto1.nl] INFO: Saving data for BX66014: {'auction_closing_time': 1774884401.0, 'created_time': 1774638646.589572, 'last_price_update_time': 1774811480.543492}
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BX66014') HTTP/1.1" 204 0
2026-03-29 19:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-29 19:11:20 [auto1.nl] INFO: Scrape type for BC50110: 0
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-29 19:11:20 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC54517%27 HTTP/1.1" 200 None
2026-03-29 19:11:20 [auto1.nl] INFO: Scrape type for VC54517: 2
2026-03-29 19:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 305c184d-8d9a-528a-86e9-11d64f03f657 with identifier: VC54517
2026-03-29 19:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 305c184d-8d9a-528a-86e9-11d64f03f657 with scrape type 2
2026-03-29 19:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 305c184d-8d9a-528a-86e9-11d64f03f657 with scrape type 2
2026-03-29 19:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 305c184d-8d9a-528a-86e9-11d64f03f657, identifier: VC54517
2026-03-29 19:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 305c184d-8d9a-528a-86e9-11d64f03f657 with identifier: VC54517
2026-03-29 19:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 305c184d-8d9a-528a-86e9-11d64f03f657 with identifier: VC54517
2026-03-29 19:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 305c184d-8d9a-528a-86e9-11d64f03f657 with identifier: VC54517 to the API
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:47Z',
 'fuel_type': 'petrol',
 'id': '305c184d-8d9a-528a-86e9-11d64f03f657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC54517',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 201690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-19',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC54517%27 HTTP/1.1" 200 None
2026-03-29 19:11:21 [auto1.nl] INFO: Saving data for VC54517: {'auction_closing_time': 1774883447.0, 'created_time': 1774725073.382362, 'last_price_update_time': 1774811481.032834}
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VC54517') HTTP/1.1" 204 0
2026-03-29 19:11:21 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-29 19:11:21 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY11680%27 HTTP/1.1" 200 None
2026-03-29 19:11:21 [auto1.nl] INFO: Scrape type for BY11680: 2
2026-03-29 19:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00fe4caf-1d24-5435-86fa-71a7c9a38274 with identifier: BY11680
2026-03-29 19:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00fe4caf-1d24-5435-86fa-71a7c9a38274 with scrape type 2
2026-03-29 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00fe4caf-1d24-5435-86fa-71a7c9a38274 with scrape type 2
2026-03-29 19:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00fe4caf-1d24-5435-86fa-71a7c9a38274, identifier: BY11680
2026-03-29 19:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00fe4caf-1d24-5435-86fa-71a7c9a38274 with identifier: BY11680
2026-03-29 19:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00fe4caf-1d24-5435-86fa-71a7c9a38274 with identifier: BY11680
2026-03-29 19:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00fe4caf-1d24-5435-86fa-71a7c9a38274 with identifier: BY11680 to the API
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:14:36Z',
 'fuel_type': 'petrol',
 'id': '00fe4caf-1d24-5435-86fa-71a7c9a38274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY11680',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 222796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY11680%27 HTTP/1.1" 200 None
2026-03-29 19:11:21 [auto1.nl] INFO: Saving data for BY11680: {'auction_closing_time': 1774883676.0, 'created_time': 1773404908.848989, 'last_price_update_time': 1774811481.411668}
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY11680') HTTP/1.1" 204 0
2026-03-29 19:11:21 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 758 | hits on page: 40
2026-03-29 19:11:21 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-29 19:11:21 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC21131%27 HTTP/1.1" 200 None
2026-03-29 19:11:21 [auto1.nl] INFO: Scrape type for VC21131: 2
2026-03-29 19:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with identifier: VC21131
2026-03-29 19:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with scrape type 2
2026-03-29 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with scrape type 2
2026-03-29 19:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 45c123dd-0dd6-58a4-86b2-cf7deed57d80, identifier: VC21131
2026-03-29 19:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with identifier: VC21131
2026-03-29 19:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with identifier: VC21131
2026-03-29 19:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 45c123dd-0dd6-58a4-86b2-cf7deed57d80 with identifier: VC21131 to the API
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:31:54Z',
 'fuel_type': 'petrol',
 'id': '45c123dd-0dd6-58a4-86b2-cf7deed57d80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC21131',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 331075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-27',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC21131%27 HTTP/1.1" 200 None
2026-03-29 19:11:21 [auto1.nl] INFO: Saving data for VC21131: {'auction_closing_time': 1774884714.0, 'created_time': 1774725071.786452, 'last_price_update_time': 1774811481.781188}
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VC21131') HTTP/1.1" 204 0
2026-03-29 19:11:21 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-29 19:11:21 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL62659%27 HTTP/1.1" 200 None
2026-03-29 19:11:21 [auto1.nl] INFO: Scrape type for HL62659: 2
2026-03-29 19:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88813e8-b510-5040-91b7-85945afd3d33 with identifier: HL62659
2026-03-29 19:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88813e8-b510-5040-91b7-85945afd3d33 with scrape type 2
2026-03-29 19:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88813e8-b510-5040-91b7-85945afd3d33 with scrape type 2
2026-03-29 19:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f88813e8-b510-5040-91b7-85945afd3d33, identifier: HL62659
2026-03-29 19:11:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:11:21 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR81542%27 HTTP/1.1" 200 None
2026-03-29 19:11:22 [auto1.nl] INFO: Scrape type for UR81542: 2
2026-03-29 19:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3401a8b0-13c2-5a20-985d-597667095bfe with identifier: UR81542
2026-03-29 19:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3401a8b0-13c2-5a20-985d-597667095bfe with scrape type 2
2026-03-29 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3401a8b0-13c2-5a20-985d-597667095bfe with scrape type 2
2026-03-29 19:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3401a8b0-13c2-5a20-985d-597667095bfe, identifier: UR81542
2026-03-29 19:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f88813e8-b510-5040-91b7-85945afd3d33 with identifier: HL62659
2026-03-29 19:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f88813e8-b510-5040-91b7-85945afd3d33 with identifier: HL62659
2026-03-29 19:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f88813e8-b510-5040-91b7-85945afd3d33 with identifier: HL62659 to the API
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:08:02Z',
 'fuel_type': 'petrol',
 'id': 'f88813e8-b510-5040-91b7-85945afd3d33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL62659',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 65995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2015}
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL62659%27 HTTP/1.1" 200 None
2026-03-29 19:11:22 [auto1.nl] INFO: Saving data for HL62659: {'auction_closing_time': 1774883282.0, 'created_time': 1774268045.51475, 'last_price_update_time': 1774811482.393267}
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HL62659') HTTP/1.1" 204 0
2026-03-29 19:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3401a8b0-13c2-5a20-985d-597667095bfe with identifier: UR81542
2026-03-29 19:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3401a8b0-13c2-5a20-985d-597667095bfe with identifier: UR81542
2026-03-29 19:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3401a8b0-13c2-5a20-985d-597667095bfe with identifier: UR81542 to the API
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:47:10Z',
 'fuel_type': 'petrol',
 'id': '3401a8b0-13c2-5a20-985d-597667095bfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR81542',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 313934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-30',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR81542%27 HTTP/1.1" 200 None
2026-03-29 19:11:22 [auto1.nl] INFO: Saving data for UR81542: {'auction_closing_time': 1774885630.0, 'created_time': 1774725072.407087, 'last_price_update_time': 1774811482.67145}
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR81542') HTTP/1.1" 204 0
2026-03-29 19:11:22 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF69205%27 HTTP/1.1" 200 None
2026-03-29 19:11:22 [auto1.nl] INFO: Scrape type for MF69205: 2
2026-03-29 19:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f22528e-21fa-5017-8422-f60b084097da with identifier: MF69205
2026-03-29 19:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f22528e-21fa-5017-8422-f60b084097da with scrape type 2
2026-03-29 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f22528e-21fa-5017-8422-f60b084097da with scrape type 2
2026-03-29 19:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f22528e-21fa-5017-8422-f60b084097da, identifier: MF69205
2026-03-29 19:11:22 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-29 19:11:22 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR03129%27 HTTP/1.1" 200 None
2026-03-29 19:11:22 [auto1.nl] INFO: Scrape type for BR03129: 2
2026-03-29 19:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b00510c-442a-536c-8714-52b6a8ab0e77 with identifier: BR03129
2026-03-29 19:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b00510c-442a-536c-8714-52b6a8ab0e77 with scrape type 2
2026-03-29 19:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b00510c-442a-536c-8714-52b6a8ab0e77 with scrape type 2
2026-03-29 19:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b00510c-442a-536c-8714-52b6a8ab0e77, identifier: BR03129
2026-03-29 19:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f22528e-21fa-5017-8422-f60b084097da with identifier: MF69205
2026-03-29 19:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f22528e-21fa-5017-8422-f60b084097da with identifier: MF69205
2026-03-29 19:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f22528e-21fa-5017-8422-f60b084097da with identifier: MF69205 to the API
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:42:13Z',
 'fuel_type': 'petrol',
 'id': '3f22528e-21fa-5017-8422-f60b084097da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF69205',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 128460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-21',
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF69205%27 HTTP/1.1" 200 None
2026-03-29 19:11:23 [auto1.nl] INFO: Saving data for MF69205: {'auction_closing_time': 1774885333.0, 'created_time': 1774725071.221292, 'last_price_update_time': 1774811483.205014}
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MF69205') HTTP/1.1" 204 0
2026-03-29 19:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b00510c-442a-536c-8714-52b6a8ab0e77 with identifier: BR03129
2026-03-29 19:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b00510c-442a-536c-8714-52b6a8ab0e77 with identifier: BR03129
2026-03-29 19:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b00510c-442a-536c-8714-52b6a8ab0e77 with identifier: BR03129 to the API
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:31:03Z',
 'fuel_type': 'petrol',
 'id': '5b00510c-442a-536c-8714-52b6a8ab0e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR03129',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 112978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-26',
 'seller_name': None,
 'title': 'Opel Tigra 1.8 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2007}
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR03129%27 HTTP/1.1" 200 None
2026-03-29 19:11:23 [auto1.nl] INFO: Saving data for BR03129: {'auction_closing_time': 1774884663.0, 'created_time': 1774725069.318233, 'last_price_update_time': 1774811483.479051}
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BR03129') HTTP/1.1" 204 0
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH69810%27 HTTP/1.1" 200 None
2026-03-29 19:11:23 [auto1.nl] INFO: Scrape type for DH69810: 0
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB68589%27 HTTP/1.1" 200 None
2026-03-29 19:11:23 [auto1.nl] INFO: Scrape type for DB68589: 0
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG42782%27 HTTP/1.1" 200 None
2026-03-29 19:11:23 [auto1.nl] INFO: Scrape type for WG42782: 2
2026-03-29 19:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with identifier: WG42782
2026-03-29 19:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with scrape type 2
2026-03-29 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with scrape type 2
2026-03-29 19:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430, identifier: WG42782
2026-03-29 19:11:23 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP28763%27 HTTP/1.1" 200 None
2026-03-29 19:11:23 [auto1.nl] INFO: Scrape type for XP28763: 2
2026-03-29 19:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1285dc26-211a-5a50-adf3-2270d56475fe with identifier: XP28763
2026-03-29 19:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1285dc26-211a-5a50-adf3-2270d56475fe with scrape type 2
2026-03-29 19:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1285dc26-211a-5a50-adf3-2270d56475fe with scrape type 2
2026-03-29 19:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1285dc26-211a-5a50-adf3-2270d56475fe, identifier: XP28763
2026-03-29 19:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with identifier: WG42782
2026-03-29 19:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with identifier: WG42782
2026-03-29 19:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 55f9cc18-dd3e-5ba7-aab3-701e7daf1430 with identifier: WG42782 to the API
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:10:38Z',
 'fuel_type': 'petrol',
 'id': '55f9cc18-dd3e-5ba7-aab3-701e7daf1430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG42782',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 157110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-09',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 400 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG42782%27 HTTP/1.1" 200 None
2026-03-29 19:11:23 [auto1.nl] INFO: Saving data for WG42782: {'auction_closing_time': 1774883438.0, 'created_time': 1774725081.977534, 'last_price_update_time': 1774811483.997888}
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG42782') HTTP/1.1" 204 0
2026-03-29 19:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1285dc26-211a-5a50-adf3-2270d56475fe with identifier: XP28763
2026-03-29 19:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1285dc26-211a-5a50-adf3-2270d56475fe with identifier: XP28763
2026-03-29 19:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1285dc26-211a-5a50-adf3-2270d56475fe with identifier: XP28763 to the API
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'petrol',
 'id': '1285dc26-211a-5a50-adf3-2270d56475fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP28763',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 209218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-11',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP28763%27 HTTP/1.1" 200 None
2026-03-29 19:11:24 [auto1.nl] INFO: Saving data for XP28763: {'auction_closing_time': 1774883761.0, 'created_time': 1774725074.966806, 'last_price_update_time': 1774811484.382294}
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XP28763') HTTP/1.1" 204 0
2026-03-29 19:11:24 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF41961%27 HTTP/1.1" 200 None
2026-03-29 19:11:24 [auto1.nl] INFO: Scrape type for RF41961: 2
2026-03-29 19:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with identifier: RF41961
2026-03-29 19:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with scrape type 2
2026-03-29 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with scrape type 2
2026-03-29 19:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6, identifier: RF41961
2026-03-29 19:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with identifier: RF41961
2026-03-29 19:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with identifier: RF41961
2026-03-29 19:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1d1ee20f-1889-5c57-a477-c3eeedcb09d6 with identifier: RF41961 to the API
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-30T15:41:49Z',
 'fuel_type': 'petrol',
 'id': '1d1ee20f-1889-5c57-a477-c3eeedcb09d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF41961',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 87794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-09',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Authentique',
 'transmission': 'automatic',
 'trim': 'Authentique',
 'year': 2005}
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF41961%27 HTTP/1.1" 200 None
2026-03-29 19:11:24 [auto1.nl] INFO: Saving data for RF41961: {'auction_closing_time': 1774885309.0, 'created_time': 1774725083.033136, 'last_price_update_time': 1774811484.77909}
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF41961') HTTP/1.1" 204 0
2026-03-29 19:11:24 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC40672%27 HTTP/1.1" 200 None
2026-03-29 19:11:24 [auto1.nl] INFO: Scrape type for BC40672: 2
2026-03-29 19:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 888bc9db-6aca-564e-856a-1017eb9fe8d0 with identifier: BC40672
2026-03-29 19:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888bc9db-6aca-564e-856a-1017eb9fe8d0 with scrape type 2
2026-03-29 19:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 888bc9db-6aca-564e-856a-1017eb9fe8d0 with scrape type 2
2026-03-29 19:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 888bc9db-6aca-564e-856a-1017eb9fe8d0, identifier: BC40672
2026-03-29 19:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 888bc9db-6aca-564e-856a-1017eb9fe8d0 with identifier: BC40672
2026-03-29 19:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 888bc9db-6aca-564e-856a-1017eb9fe8d0 with identifier: BC40672
2026-03-29 19:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 888bc9db-6aca-564e-856a-1017eb9fe8d0 with identifier: BC40672 to the API
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:53:40Z',
 'fuel_type': 'petrol',
 'id': '888bc9db-6aca-564e-856a-1017eb9fe8d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC40672',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS3',
 'odometer': 106455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'DS Automobiles DS3 1.6 THP SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2016}
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC40672%27 HTTP/1.1" 200 None
2026-03-29 19:11:25 [auto1.nl] INFO: Saving data for BC40672: {'auction_closing_time': 1774886020.0, 'created_time': 1774725084.428186, 'last_price_update_time': 1774811485.204096}
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC40672') HTTP/1.1" 204 0
2026-03-29 19:11:25 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR08670%27 HTTP/1.1" 200 None
2026-03-29 19:11:25 [auto1.nl] INFO: Scrape type for PR08670: 0
2026-03-29 19:11:25 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-29 19:11:25 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-29 19:11:25 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-29 19:11:25 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-29 19:11:25 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR36555%27 HTTP/1.1" 200 None
2026-03-29 19:11:25 [auto1.nl] INFO: Scrape type for DR36555: 0
2026-03-29 19:11:25 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ98625%27 HTTP/1.1" 200 None
2026-03-29 19:11:25 [auto1.nl] INFO: Scrape type for BZ98625: 2
2026-03-29 19:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with identifier: BZ98625
2026-03-29 19:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with scrape type 2
2026-03-29 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with scrape type 2
2026-03-29 19:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 18b7197c-ab02-5d31-b33b-0de3f73c7c85, identifier: BZ98625
2026-03-29 19:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with identifier: BZ98625
2026-03-29 19:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with identifier: BZ98625
2026-03-29 19:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 18b7197c-ab02-5d31-b33b-0de3f73c7c85 with identifier: BZ98625 to the API
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:06:43Z',
 'fuel_type': 'petrol',
 'id': '18b7197c-ab02-5d31-b33b-0de3f73c7c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ98625',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 153417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-16',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ98625%27 HTTP/1.1" 200 None
2026-03-29 19:11:25 [auto1.nl] INFO: Saving data for BZ98625: {'auction_closing_time': 1774883203.0, 'created_time': 1774725084.847055, 'last_price_update_time': 1774811485.625126}
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ98625') HTTP/1.1" 204 0
2026-03-29 19:11:25 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM68754%27 HTTP/1.1" 200 None
2026-03-29 19:11:25 [auto1.nl] INFO: Scrape type for GM68754: 2
2026-03-29 19:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3754e0-6998-570e-8063-a7132f9bf4c7 with identifier: GM68754
2026-03-29 19:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3754e0-6998-570e-8063-a7132f9bf4c7 with scrape type 2
2026-03-29 19:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f3754e0-6998-570e-8063-a7132f9bf4c7 with scrape type 2
2026-03-29 19:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f3754e0-6998-570e-8063-a7132f9bf4c7, identifier: GM68754
2026-03-29 19:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f3754e0-6998-570e-8063-a7132f9bf4c7 with identifier: GM68754
2026-03-29 19:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f3754e0-6998-570e-8063-a7132f9bf4c7 with identifier: GM68754
2026-03-29 19:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f3754e0-6998-570e-8063-a7132f9bf4c7 with identifier: GM68754 to the API
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:36:02Z',
 'fuel_type': 'petrol',
 'id': '3f3754e0-6998-570e-8063-a7132f9bf4c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM68754',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 369511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-05',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2011}
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM68754%27 HTTP/1.1" 200 None
2026-03-29 19:11:26 [auto1.nl] INFO: Saving data for GM68754: {'auction_closing_time': 1774884962.0, 'created_time': 1774725076.409635, 'last_price_update_time': 1774811486.018736}
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GM68754') HTTP/1.1" 204 0
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP71821%27 HTTP/1.1" 200 None
2026-03-29 19:11:26 [auto1.nl] INFO: Scrape type for JP71821: 0
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG04233%27 HTTP/1.1" 200 None
2026-03-29 19:11:26 [auto1.nl] INFO: Scrape type for BG04233: 2
2026-03-29 19:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58458355-b826-5983-adfc-801a3ea42012 with identifier: BG04233
2026-03-29 19:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58458355-b826-5983-adfc-801a3ea42012 with scrape type 2
2026-03-29 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58458355-b826-5983-adfc-801a3ea42012 with scrape type 2
2026-03-29 19:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58458355-b826-5983-adfc-801a3ea42012, identifier: BG04233
2026-03-29 19:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58458355-b826-5983-adfc-801a3ea42012 with identifier: BG04233
2026-03-29 19:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58458355-b826-5983-adfc-801a3ea42012 with identifier: BG04233
2026-03-29 19:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58458355-b826-5983-adfc-801a3ea42012 with identifier: BG04233 to the API
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:47Z',
 'fuel_type': 'petrol',
 'id': '58458355-b826-5983-adfc-801a3ea42012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG04233',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 111228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-08',
 'seller_name': None,
 'title': 'BMW 3er 318i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2018}
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG04233%27 HTTP/1.1" 200 None
2026-03-29 19:11:26 [auto1.nl] INFO: Saving data for BG04233: {'auction_closing_time': 1774886027.0, 'created_time': 1774725074.25527, 'last_price_update_time': 1774811486.424471}
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG04233') HTTP/1.1" 204 0
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-29 19:11:26 [auto1.nl] INFO: Scrape type for AT06250: 2
2026-03-29 19:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-29 19:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657fc4a3-6836-5e36-9e93-986b184640ec with scrape type 2
2026-03-29 19:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 657fc4a3-6836-5e36-9e93-986b184640ec with scrape type 2
2026-03-29 19:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 657fc4a3-6836-5e36-9e93-986b184640ec, identifier: AT06250
2026-03-29 19:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-29 19:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-29 19:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250 to the API
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:20:37Z',
 'fuel_type': 'petrol',
 'id': '657fc4a3-6836-5e36-9e93-986b184640ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT06250',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 83795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-29 19:11:26 [auto1.nl] INFO: Saving data for AT06250: {'auction_closing_time': 1774884037.0, 'created_time': 1773232172.092675, 'last_price_update_time': 1774811486.949571}
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AT06250') HTTP/1.1" 204 0
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW17706%27 HTTP/1.1" 200 None
2026-03-29 19:11:26 [auto1.nl] INFO: Scrape type for JW17706: 0
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU81834%27 HTTP/1.1" 200 None
2026-03-29 19:11:26 [auto1.nl] INFO: Scrape type for GU81834: 0
2026-03-29 19:11:26 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC15859%27 HTTP/1.1" 200 None
2026-03-29 19:11:27 [auto1.nl] INFO: Scrape type for BC15859: 0
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR27425%27 HTTP/1.1" 200 None
2026-03-29 19:11:27 [auto1.nl] INFO: Scrape type for XR27425: 0
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME79677%27 HTTP/1.1" 200 None
2026-03-29 19:11:27 [auto1.nl] INFO: Scrape type for ME79677: 0
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-29 19:11:27 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 758 | hits on page: 40
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT04530%27 HTTP/1.1" 200 None
2026-03-29 19:11:27 [auto1.nl] INFO: Scrape type for PT04530: 0
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS03610%27 HTTP/1.1" 200 None
2026-03-29 19:11:27 [auto1.nl] INFO: Scrape type for PS03610: 2
2026-03-29 19:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ceab952-c7a1-5a3f-a41b-5d8791306833 with identifier: PS03610
2026-03-29 19:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ceab952-c7a1-5a3f-a41b-5d8791306833 with scrape type 2
2026-03-29 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ceab952-c7a1-5a3f-a41b-5d8791306833 with scrape type 2
2026-03-29 19:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ceab952-c7a1-5a3f-a41b-5d8791306833, identifier: PS03610
2026-03-29 19:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ceab952-c7a1-5a3f-a41b-5d8791306833 with identifier: PS03610
2026-03-29 19:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ceab952-c7a1-5a3f-a41b-5d8791306833 with identifier: PS03610
2026-03-29 19:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ceab952-c7a1-5a3f-a41b-5d8791306833 with identifier: PS03610 to the API
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:45:16Z',
 'fuel_type': 'petrol',
 'id': '4ceab952-c7a1-5a3f-a41b-5d8791306833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS03610',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 187170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-09',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2009}
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS03610%27 HTTP/1.1" 200 None
2026-03-29 19:11:27 [auto1.nl] INFO: Saving data for PS03610: {'auction_closing_time': 1774885516.0, 'created_time': 1774725086.579861, 'last_price_update_time': 1774811487.458744}
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS03610') HTTP/1.1" 204 0
2026-03-29 19:11:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18286%27 HTTP/1.1" 200 None
2026-03-29 19:11:27 [auto1.nl] INFO: Scrape type for MD18286: 0
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-29 19:11:27 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB08844%27 HTTP/1.1" 200 None
2026-03-29 19:11:27 [auto1.nl] INFO: Scrape type for EB08844: 2
2026-03-29 19:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 190e717f-ff9a-5b59-88b1-d88d712596ee with identifier: EB08844
2026-03-29 19:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 190e717f-ff9a-5b59-88b1-d88d712596ee with scrape type 2
2026-03-29 19:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 190e717f-ff9a-5b59-88b1-d88d712596ee with scrape type 2
2026-03-29 19:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 190e717f-ff9a-5b59-88b1-d88d712596ee, identifier: EB08844
2026-03-29 19:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 190e717f-ff9a-5b59-88b1-d88d712596ee with identifier: EB08844
2026-03-29 19:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 190e717f-ff9a-5b59-88b1-d88d712596ee with identifier: EB08844
2026-03-29 19:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 190e717f-ff9a-5b59-88b1-d88d712596ee with identifier: EB08844 to the API
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:52Z',
 'fuel_type': 'petrol',
 'id': '190e717f-ff9a-5b59-88b1-d88d712596ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB08844',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 69788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB08844%27 HTTP/1.1" 200 None
2026-03-29 19:11:28 [auto1.nl] INFO: Saving data for EB08844: {'auction_closing_time': 1774883872.0, 'created_time': 1774725085.682537, 'last_price_update_time': 1774811488.021387}
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB08844') HTTP/1.1" 204 0
2026-03-29 19:11:28 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-29 19:11:28 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-29 19:11:28 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV55742%27 HTTP/1.1" 200 None
2026-03-29 19:11:28 [auto1.nl] INFO: Scrape type for PV55742: 2
2026-03-29 19:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e099d074-6494-54ac-87a1-586587e4e464 with identifier: PV55742
2026-03-29 19:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e099d074-6494-54ac-87a1-586587e4e464 with scrape type 2
2026-03-29 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e099d074-6494-54ac-87a1-586587e4e464 with scrape type 2
2026-03-29 19:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e099d074-6494-54ac-87a1-586587e4e464, identifier: PV55742
2026-03-29 19:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e099d074-6494-54ac-87a1-586587e4e464 with identifier: PV55742
2026-03-29 19:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e099d074-6494-54ac-87a1-586587e4e464 with identifier: PV55742
2026-03-29 19:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e099d074-6494-54ac-87a1-586587e4e464 with identifier: PV55742 to the API
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:41:31Z',
 'fuel_type': 'petrol',
 'id': 'e099d074-6494-54ac-87a1-586587e4e464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV55742',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 201614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-23',
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'M Sport Shadow',
 'year': 2018}
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV55742%27 HTTP/1.1" 200 None
2026-03-29 19:11:28 [auto1.nl] INFO: Saving data for PV55742: {'auction_closing_time': 1774885291.0, 'created_time': 1774725083.343463, 'last_price_update_time': 1774811488.38826}
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PV55742') HTTP/1.1" 204 0
2026-03-29 19:11:28 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-29 19:11:28 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM51490%27 HTTP/1.1" 200 None
2026-03-29 19:11:28 [auto1.nl] INFO: Scrape type for AM51490: 2
2026-03-29 19:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with identifier: AM51490
2026-03-29 19:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with scrape type 2
2026-03-29 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with scrape type 2
2026-03-29 19:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d0916bfb-102e-5f67-bee4-ca18b2f0ece2, identifier: AM51490
2026-03-29 19:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with identifier: AM51490
2026-03-29 19:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with identifier: AM51490
2026-03-29 19:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d0916bfb-102e-5f67-bee4-ca18b2f0ece2 with identifier: AM51490 to the API
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': 'd0916bfb-102e-5f67-bee4-ca18b2f0ece2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM51490',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 101589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'M Sport Shadow',
 'year': 2019}
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM51490%27 HTTP/1.1" 200 None
2026-03-29 19:11:28 [auto1.nl] INFO: Saving data for AM51490: {'auction_closing_time': 1774884768.0, 'created_time': 1774725077.553574, 'last_price_update_time': 1774811488.782635}
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AM51490') HTTP/1.1" 204 0
2026-03-29 19:11:28 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-29 19:11:28 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-29 19:11:28 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD35327%27 HTTP/1.1" 200 None
2026-03-29 19:11:28 [auto1.nl] INFO: Scrape type for MD35327: 2
2026-03-29 19:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55efb71b-7c15-56d8-bb75-cbc941182b05 with identifier: MD35327
2026-03-29 19:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55efb71b-7c15-56d8-bb75-cbc941182b05 with scrape type 2
2026-03-29 19:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55efb71b-7c15-56d8-bb75-cbc941182b05 with scrape type 2
2026-03-29 19:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 55efb71b-7c15-56d8-bb75-cbc941182b05, identifier: MD35327
2026-03-29 19:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 55efb71b-7c15-56d8-bb75-cbc941182b05 with identifier: MD35327
2026-03-29 19:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 55efb71b-7c15-56d8-bb75-cbc941182b05 with identifier: MD35327
2026-03-29 19:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 55efb71b-7c15-56d8-bb75-cbc941182b05 with identifier: MD35327 to the API
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:14:30Z',
 'fuel_type': 'petrol',
 'id': '55efb71b-7c15-56d8-bb75-cbc941182b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD35327',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 149738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2011}
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD35327%27 HTTP/1.1" 200 None
2026-03-29 19:11:29 [auto1.nl] INFO: Saving data for MD35327: {'auction_closing_time': 1774883670.0, 'created_time': 1774725079.975572, 'last_price_update_time': 1774811489.165497}
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD35327') HTTP/1.1" 204 0
2026-03-29 19:11:29 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-29 19:11:29 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-29 19:11:29 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-29 19:11:29 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR09691%27 HTTP/1.1" 200 None
2026-03-29 19:11:29 [auto1.nl] INFO: Scrape type for TR09691: 2
2026-03-29 19:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dba382fd-1d5f-5600-8a91-36831d820517 with identifier: TR09691
2026-03-29 19:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba382fd-1d5f-5600-8a91-36831d820517 with scrape type 2
2026-03-29 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dba382fd-1d5f-5600-8a91-36831d820517 with scrape type 2
2026-03-29 19:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dba382fd-1d5f-5600-8a91-36831d820517, identifier: TR09691
2026-03-29 19:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dba382fd-1d5f-5600-8a91-36831d820517 with identifier: TR09691
2026-03-29 19:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dba382fd-1d5f-5600-8a91-36831d820517 with identifier: TR09691
2026-03-29 19:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dba382fd-1d5f-5600-8a91-36831d820517 with identifier: TR09691 to the API
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:52Z',
 'fuel_type': 'petrol',
 'id': 'dba382fd-1d5f-5600-8a91-36831d820517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR09691',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 78186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-05',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Attractive',
 'transmission': 'manual',
 'trim': 'Attractive',
 'year': 2011}
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR09691%27 HTTP/1.1" 200 None
2026-03-29 19:11:29 [auto1.nl] INFO: Saving data for TR09691: {'auction_closing_time': 1774884172.0, 'created_time': 1773429235.774523, 'last_price_update_time': 1774811489.645404}
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TR09691') HTTP/1.1" 204 0
2026-03-29 19:11:29 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-29 19:11:29 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX19183%27 HTTP/1.1" 200 None
2026-03-29 19:11:29 [auto1.nl] INFO: Scrape type for KX19183: 2
2026-03-29 19:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with identifier: KX19183
2026-03-29 19:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with scrape type 2
2026-03-29 19:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with scrape type 2
2026-03-29 19:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd, identifier: KX19183
2026-03-29 19:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with identifier: KX19183
2026-03-29 19:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with identifier: KX19183
2026-03-29 19:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04cdf1a4-1c94-55ef-bc88-3b56b7b834dd with identifier: KX19183 to the API
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:27Z',
 'fuel_type': 'petrol',
 'id': '04cdf1a4-1c94-55ef-bc88-3b56b7b834dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX19183',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 151638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-10',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2011}
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX19183%27 HTTP/1.1" 200 None
2026-03-29 19:11:30 [auto1.nl] INFO: Saving data for KX19183: {'auction_closing_time': 1774884267.0, 'created_time': 1774725075.840157, 'last_price_update_time': 1774811490.034353}
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX19183') HTTP/1.1" 204 0
2026-03-29 19:11:30 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-29 19:11:30 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-29 19:11:30 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-29 19:11:30 [auto1.nl] INFO: Scrape type for JH24547: 2
2026-03-29 19:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-29 19:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64fcd272-55ff-5554-82d7-a83a99840a93 with scrape type 2
2026-03-29 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64fcd272-55ff-5554-82d7-a83a99840a93 with scrape type 2
2026-03-29 19:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64fcd272-55ff-5554-82d7-a83a99840a93, identifier: JH24547
2026-03-29 19:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 19:11:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-29 19:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547 to the API
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:59:26Z',
 'fuel_type': 'petrol',
 'id': '64fcd272-55ff-5554-82d7-a83a99840a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH24547',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 134675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Citroen C3 1.4 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2011}
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-29 19:11:30 [auto1.nl] INFO: Saving data for JH24547: {'auction_closing_time': 1774886366.0, 'created_time': 1774002007.214212, 'last_price_update_time': 1774811490.723067}
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH24547') HTTP/1.1" 204 0
2026-03-29 19:11:30 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL97424%27 HTTP/1.1" 200 None
2026-03-29 19:11:30 [auto1.nl] INFO: Scrape type for HL97424: 2
2026-03-29 19:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b142a74b-0dc8-5858-9e36-b6a7a45c034f with identifier: HL97424
2026-03-29 19:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b142a74b-0dc8-5858-9e36-b6a7a45c034f with scrape type 2
2026-03-29 19:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b142a74b-0dc8-5858-9e36-b6a7a45c034f with scrape type 2
2026-03-29 19:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b142a74b-0dc8-5858-9e36-b6a7a45c034f, identifier: HL97424
2026-03-29 19:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b142a74b-0dc8-5858-9e36-b6a7a45c034f with identifier: HL97424
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 19:11:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 19:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 19:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b142a74b-0dc8-5858-9e36-b6a7a45c034f with identifier: HL97424
2026-03-29 19:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b142a74b-0dc8-5858-9e36-b6a7a45c034f with identifier: HL97424 to the API
2026-03-29 19:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:51Z',
 'fuel_type': 'petrol',
 'id': 'b142a74b-0dc8-5858-9e36-b6a7a45c034f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL97424',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 123030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-01',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL97424%27 HTTP/1.1" 200 None
2026-03-29 19:11:32 [auto1.nl] INFO: Saving data for HL97424: {'auction_closing_time': 1774885311.0, 'created_time': 1774552341.297915, 'last_price_update_time': 1774811492.597742}
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HL97424') HTTP/1.1" 204 0
2026-03-29 19:11:32 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-29 19:11:32 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB85439%27 HTTP/1.1" 200 None
2026-03-29 19:11:32 [auto1.nl] INFO: Scrape type for AB85439: 2
2026-03-29 19:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64834400-65f6-529c-b167-b62b8d0bfa52 with identifier: AB85439
2026-03-29 19:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64834400-65f6-529c-b167-b62b8d0bfa52 with scrape type 2
2026-03-29 19:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64834400-65f6-529c-b167-b62b8d0bfa52 with scrape type 2
2026-03-29 19:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64834400-65f6-529c-b167-b62b8d0bfa52, identifier: AB85439
2026-03-29 19:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64834400-65f6-529c-b167-b62b8d0bfa52 with identifier: AB85439
2026-03-29 19:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64834400-65f6-529c-b167-b62b8d0bfa52 with identifier: AB85439
2026-03-29 19:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64834400-65f6-529c-b167-b62b8d0bfa52 with identifier: AB85439 to the API
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:09Z',
 'fuel_type': 'petrol',
 'id': '64834400-65f6-529c-b167-b62b8d0bfa52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB85439',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 82569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-19',
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-29 19:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB85439%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Saving data for AB85439: {'auction_closing_time': 1774882809.0, 'created_time': 1774552339.04329, 'last_price_update_time': 1774811493.005422}
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB85439') HTTP/1.1" 204 0
2026-03-29 19:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for UE65811: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for UY86442: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for WG90560: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for UR39080: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-29 19:11:33 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 758 | hits on page: 40
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for PH88105: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for UF12505: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for XK28167: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for JC30911: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for AX92237: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for UB73502: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for TP02076: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for BV07887: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for ZE09391: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for ER86910: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for DR23359: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for MH16372: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for ME24209: 0
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Scrape type for PU27111: 2
2026-03-29 19:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-29 19:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24002d7d-366e-54b7-bc2d-8df145edd940 with scrape type 2
2026-03-29 19:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24002d7d-366e-54b7-bc2d-8df145edd940 with scrape type 2
2026-03-29 19:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 24002d7d-366e-54b7-bc2d-8df145edd940, identifier: PU27111
2026-03-29 19:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-29 19:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-29 19:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111 to the API
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'petrol',
 'id': '24002d7d-366e-54b7-bc2d-8df145edd940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU27111',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 190272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-29 19:11:33 [auto1.nl] INFO: Saving data for PU27111: {'auction_closing_time': 1774883102.0, 'created_time': 1774354594.942365, 'last_price_update_time': 1774811493.832086}
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PU27111') HTTP/1.1" 204 0
2026-03-29 19:11:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-29 19:11:33 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for EH33258: 0
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for SE67800: 0
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for TN45594: 0
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK48702%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for HK48702: 2
2026-03-29 19:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce22037-fda4-5392-8390-f9d4c00e222e with identifier: HK48702
2026-03-29 19:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce22037-fda4-5392-8390-f9d4c00e222e with scrape type 2
2026-03-29 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce22037-fda4-5392-8390-f9d4c00e222e with scrape type 2
2026-03-29 19:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ce22037-fda4-5392-8390-f9d4c00e222e, identifier: HK48702
2026-03-29 19:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ce22037-fda4-5392-8390-f9d4c00e222e with identifier: HK48702
2026-03-29 19:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ce22037-fda4-5392-8390-f9d4c00e222e with identifier: HK48702
2026-03-29 19:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ce22037-fda4-5392-8390-f9d4c00e222e with identifier: HK48702 to the API
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:33:12Z',
 'fuel_type': 'petrol',
 'id': '3ce22037-fda4-5392-8390-f9d4c00e222e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK48702',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 210752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2013}
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK48702%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Saving data for HK48702: {'auction_closing_time': 1774884792.0, 'created_time': 1774699888.61163, 'last_price_update_time': 1774811494.44747}
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK48702') HTTP/1.1" 204 0
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX89333%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for PX89333: 2
2026-03-29 19:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with identifier: PX89333
2026-03-29 19:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with scrape type 2
2026-03-29 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with scrape type 2
2026-03-29 19:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a, identifier: PX89333
2026-03-29 19:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with identifier: PX89333
2026-03-29 19:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with identifier: PX89333
2026-03-29 19:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with identifier: PX89333 to the API
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:28:05Z',
 'fuel_type': 'petrol',
 'id': '58b23ea0-4a17-5e96-98ed-2f8bf768d96a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX89333',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 267476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX89333%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Saving data for PX89333: {'auction_closing_time': 1774884485.0, 'created_time': 1774699888.173009, 'last_price_update_time': 1774811494.821234}
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PX89333') HTTP/1.1" 204 0
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for JM32164: 0
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for HM06318: 0
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for KH60865: 0
2026-03-29 19:11:34 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS42620%27 HTTP/1.1" 200 None
2026-03-29 19:11:34 [auto1.nl] INFO: Scrape type for GS42620: 2
2026-03-29 19:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c929727d-ced9-597b-b6fe-4f982e0da845 with identifier: GS42620
2026-03-29 19:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c929727d-ced9-597b-b6fe-4f982e0da845 with scrape type 2
2026-03-29 19:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c929727d-ced9-597b-b6fe-4f982e0da845 with scrape type 2
2026-03-29 19:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c929727d-ced9-597b-b6fe-4f982e0da845, identifier: GS42620
2026-03-29 19:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c929727d-ced9-597b-b6fe-4f982e0da845 with identifier: GS42620
2026-03-29 19:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c929727d-ced9-597b-b6fe-4f982e0da845 with identifier: GS42620
2026-03-29 19:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c929727d-ced9-597b-b6fe-4f982e0da845 with identifier: GS42620 to the API
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:15:18Z',
 'fuel_type': 'hybrid',
 'id': 'c929727d-ced9-597b-b6fe-4f982e0da845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS42620',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 152516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS42620%27 HTTP/1.1" 200 None
2026-03-29 19:11:35 [auto1.nl] INFO: Saving data for GS42620: {'auction_closing_time': 1774883718.0, 'created_time': 1774699889.5698, 'last_price_update_time': 1774811495.256705}
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS42620') HTTP/1.1" 204 0
2026-03-29 19:11:35 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ91466%27 HTTP/1.1" 200 None
2026-03-29 19:11:35 [auto1.nl] INFO: Scrape type for YJ91466: 2
2026-03-29 19:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with identifier: YJ91466
2026-03-29 19:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with scrape type 2
2026-03-29 19:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with scrape type 2
2026-03-29 19:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5, identifier: YJ91466
2026-03-29 19:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with identifier: YJ91466
2026-03-29 19:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with identifier: YJ91466
2026-03-29 19:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with identifier: YJ91466 to the API
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:07Z',
 'fuel_type': 'petrol',
 'id': '7d1502fa-b8b4-5d69-baf5-460e0b8a50c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ91466',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 285394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion',
 'year': 2010}
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ91466%27 HTTP/1.1" 200 None
2026-03-29 19:11:35 [auto1.nl] INFO: Saving data for YJ91466: {'auction_closing_time': 1774886227.0, 'created_time': 1774699888.957934, 'last_price_update_time': 1774811495.715591}
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YJ91466') HTTP/1.1" 204 0
2026-03-29 19:11:35 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-29 19:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:36 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 758 | hits on page: 40
2026-03-29 19:11:36 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-29 19:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-29 19:11:37 [auto1.nl] INFO: Scrape type for PA65227: 0
2026-03-29 19:11:37 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-29 19:11:37 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-29 19:11:37 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG71940%27 HTTP/1.1" 200 None
2026-03-29 19:11:37 [auto1.nl] INFO: Scrape type for HG71940: 2
2026-03-29 19:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2261bba-4ad7-59f6-9065-e85e70f08a34 with identifier: HG71940
2026-03-29 19:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2261bba-4ad7-59f6-9065-e85e70f08a34 with scrape type 2
2026-03-29 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2261bba-4ad7-59f6-9065-e85e70f08a34 with scrape type 2
2026-03-29 19:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2261bba-4ad7-59f6-9065-e85e70f08a34, identifier: HG71940
2026-03-29 19:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2261bba-4ad7-59f6-9065-e85e70f08a34 with identifier: HG71940
2026-03-29 19:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2261bba-4ad7-59f6-9065-e85e70f08a34 with identifier: HG71940
2026-03-29 19:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2261bba-4ad7-59f6-9065-e85e70f08a34 with identifier: HG71940 to the API
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:55:08Z',
 'fuel_type': 'electro',
 'id': 'd2261bba-4ad7-59f6-9065-e85e70f08a34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG71940',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 115176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seller_name': None,
 'title': 'Skoda Enyaq iV 60 Loft',
 'transmission': 'automatic',
 'trim': 'Loft',
 'year': 2021}
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG71940%27 HTTP/1.1" 200 None
2026-03-29 19:11:37 [auto1.nl] INFO: Saving data for HG71940: {'auction_closing_time': 1774886108.0, 'created_time': 1774699881.114814, 'last_price_update_time': 1774811497.384985}
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HG71940') HTTP/1.1" 204 0
2026-03-29 19:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:11:37 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-29 19:11:37 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-29 19:11:37 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV57262%27 HTTP/1.1" 200 None
2026-03-29 19:11:37 [auto1.nl] INFO: Scrape type for MV57262: 2
2026-03-29 19:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 115aff30-f8cd-5ade-a05f-8496a45db92e with identifier: MV57262
2026-03-29 19:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115aff30-f8cd-5ade-a05f-8496a45db92e with scrape type 2
2026-03-29 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 115aff30-f8cd-5ade-a05f-8496a45db92e with scrape type 2
2026-03-29 19:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 115aff30-f8cd-5ade-a05f-8496a45db92e, identifier: MV57262
2026-03-29 19:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 115aff30-f8cd-5ade-a05f-8496a45db92e with identifier: MV57262
2026-03-29 19:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 115aff30-f8cd-5ade-a05f-8496a45db92e with identifier: MV57262
2026-03-29 19:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 115aff30-f8cd-5ade-a05f-8496a45db92e with identifier: MV57262 to the API
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:12:21Z',
 'fuel_type': 'electro',
 'id': '115aff30-f8cd-5ade-a05f-8496a45db92e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV57262',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 103065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2022}
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV57262%27 HTTP/1.1" 200 None
2026-03-29 19:11:37 [auto1.nl] INFO: Saving data for MV57262: {'auction_closing_time': 1774883541.0, 'created_time': 1774699884.14666, 'last_price_update_time': 1774811497.762701}
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MV57262') HTTP/1.1" 204 0
2026-03-29 19:11:37 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS29188%27 HTTP/1.1" 200 None
2026-03-29 19:11:37 [auto1.nl] INFO: Scrape type for VS29188: 2
2026-03-29 19:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e2502d-82d3-5114-98c3-29dc66abc3a0 with identifier: VS29188
2026-03-29 19:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e2502d-82d3-5114-98c3-29dc66abc3a0 with scrape type 2
2026-03-29 19:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e2502d-82d3-5114-98c3-29dc66abc3a0 with scrape type 2
2026-03-29 19:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28e2502d-82d3-5114-98c3-29dc66abc3a0, identifier: VS29188
2026-03-29 19:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28e2502d-82d3-5114-98c3-29dc66abc3a0 with identifier: VS29188
2026-03-29 19:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28e2502d-82d3-5114-98c3-29dc66abc3a0 with identifier: VS29188
2026-03-29 19:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28e2502d-82d3-5114-98c3-29dc66abc3a0 with identifier: VS29188 to the API
2026-03-29 19:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:20:48Z',
 'fuel_type': 'electro',
 'id': '28e2502d-82d3-5114-98c3-29dc66abc3a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS29188',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 102100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW 1st Plus Pro Performance',
 'transmission': 'automatic',
 'trim': '1st Plus Pro Performance',
 'year': 2020}
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS29188%27 HTTP/1.1" 200 None
2026-03-29 19:11:38 [auto1.nl] INFO: Saving data for VS29188: {'auction_closing_time': 1774884048.0, 'created_time': 1774699886.552915, 'last_price_update_time': 1774811498.134322}
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VS29188') HTTP/1.1" 204 0
2026-03-29 19:11:38 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-29 19:11:38 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ45478%27 HTTP/1.1" 200 None
2026-03-29 19:11:38 [auto1.nl] INFO: Scrape type for ZZ45478: 2
2026-03-29 19:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d4dfb6-028c-5bf0-991e-b83ff5197eef with identifier: ZZ45478
2026-03-29 19:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef with scrape type 2
2026-03-29 19:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef with scrape type 2
2026-03-29 19:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5d4dfb6-028c-5bf0-991e-b83ff5197eef, identifier: ZZ45478
2026-03-29 19:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5d4dfb6-028c-5bf0-991e-b83ff5197eef with identifier: ZZ45478
2026-03-29 19:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5d4dfb6-028c-5bf0-991e-b83ff5197eef with identifier: ZZ45478
2026-03-29 19:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5d4dfb6-028c-5bf0-991e-b83ff5197eef with identifier: ZZ45478 to the API
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:03:08Z',
 'fuel_type': 'electro',
 'id': 'f5d4dfb6-028c-5bf0-991e-b83ff5197eef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ45478',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 101042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seller_name': None,
 'title': 'Skoda Enyaq iV 60 Loft',
 'transmission': 'automatic',
 'trim': 'Loft',
 'year': 2022}
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ45478%27 HTTP/1.1" 200 None
2026-03-29 19:11:38 [auto1.nl] INFO: Saving data for ZZ45478: {'auction_closing_time': 1774882988.0, 'created_time': 1774699884.539897, 'last_price_update_time': 1774811498.513127}
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZZ45478') HTTP/1.1" 204 0
2026-03-29 19:11:38 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-29 19:11:38 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW57039%27 HTTP/1.1" 200 None
2026-03-29 19:11:38 [auto1.nl] INFO: Scrape type for RW57039: 2
2026-03-29 19:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with identifier: RW57039
2026-03-29 19:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with scrape type 2
2026-03-29 19:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with scrape type 2
2026-03-29 19:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44, identifier: RW57039
2026-03-29 19:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with identifier: RW57039
2026-03-29 19:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with identifier: RW57039
2026-03-29 19:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with identifier: RW57039 to the API
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:13:32Z',
 'fuel_type': 'diesel',
 'id': 'ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW57039',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 183210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2017}
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW57039%27 HTTP/1.1" 200 None
2026-03-29 19:11:38 [auto1.nl] INFO: Saving data for RW57039: {'auction_closing_time': 1774883612.0, 'created_time': 1774699885.277667, 'last_price_update_time': 1774811498.983919}
2026-03-29 19:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RW57039') HTTP/1.1" 204 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM15601%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for HM15601: 2
2026-03-29 19:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41034e0-3e6a-5956-9bab-f3ff15d849cf with identifier: HM15601
2026-03-29 19:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41034e0-3e6a-5956-9bab-f3ff15d849cf with scrape type 2
2026-03-29 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41034e0-3e6a-5956-9bab-f3ff15d849cf with scrape type 2
2026-03-29 19:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d41034e0-3e6a-5956-9bab-f3ff15d849cf, identifier: HM15601
2026-03-29 19:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d41034e0-3e6a-5956-9bab-f3ff15d849cf with identifier: HM15601
2026-03-29 19:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d41034e0-3e6a-5956-9bab-f3ff15d849cf with identifier: HM15601
2026-03-29 19:11:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d41034e0-3e6a-5956-9bab-f3ff15d849cf with identifier: HM15601 to the API
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:03:17Z',
 'fuel_type': 'diesel',
 'id': 'd41034e0-3e6a-5956-9bab-f3ff15d849cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM15601',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 431750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Opel Movano 2.3 CDTI Ka L1H1 3,5t',
 'transmission': 'manual',
 'trim': 'Ka L1H1 3,5t',
 'year': 2016}
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM15601%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Saving data for HM15601: {'auction_closing_time': 1774882997.0, 'created_time': 1774699886.192287, 'last_price_update_time': 1774811499.379159}
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM15601') HTTP/1.1" 204 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP36316%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for GP36316: 2
2026-03-29 19:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9c4788-5458-5560-baf2-1f3702bf94b0 with identifier: GP36316
2026-03-29 19:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9c4788-5458-5560-baf2-1f3702bf94b0 with scrape type 2
2026-03-29 19:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a9c4788-5458-5560-baf2-1f3702bf94b0 with scrape type 2
2026-03-29 19:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a9c4788-5458-5560-baf2-1f3702bf94b0, identifier: GP36316
2026-03-29 19:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a9c4788-5458-5560-baf2-1f3702bf94b0 with identifier: GP36316
2026-03-29 19:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a9c4788-5458-5560-baf2-1f3702bf94b0 with identifier: GP36316
2026-03-29 19:11:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a9c4788-5458-5560-baf2-1f3702bf94b0 with identifier: GP36316 to the API
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 19:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:50:23Z',
 'fuel_type': 'hybrid',
 'id': '5a9c4788-5458-5560-baf2-1f3702bf94b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP36316',
 'listing': 'auction',
 'make': 'Lynk & Co',
 'model': '01',
 'odometer': 101274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seller_name': None,
 'title': 'Lynk & Co 01 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP36316%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Saving data for GP36316: {'auction_closing_time': 1774885823.0, 'created_time': 1774699883.18416, 'last_price_update_time': 1774811499.750163}
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GP36316') HTTP/1.1" 204 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for UE83954: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for XG85677: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for SX97177: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for PF57895: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for HV92208: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for WY33906: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for WN49119: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for XM87869: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-29 19:11:39 [auto1.nl] INFO: Scrape type for FB82909: 0
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-29 19:11:39 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-29 19:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:41 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 758 | hits on page: 38
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for YX65431: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for MZ74119: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for GW58352: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for JB09830: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for CY78777: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for DL13637: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for CD19489: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for RY80321: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for KC04488: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for SK13348: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for JB39700: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for NZ86515: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for WK03460: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for FG02230: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for NX59327: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for AB36156: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for JW97628: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for LR40141: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for EP93197: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for DT42929: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 19:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-29 19:11:41 [auto1.nl] INFO: Scrape type for AV73218: 0
2026-03-29 19:11:41 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-29 19:11:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 19:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 19:11:42 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 758 | hits on page: 0
2026-03-29 19:11:42 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 19:11:42 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-29 19:11:42 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 30, <ScrapeType.BATCH_SKIPPED: 5>: 35}
2026-03-29 19:11:42 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (148 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-29T19_10_00.jl
2026-03-29 19:11:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 64016,
 'downloader/request_count': 24,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 22,
 'downloader/response_bytes': 3430032,
 'downloader/response_count': 24,
 'downloader/response_status_count/200': 24,
 'elapsed_time_seconds': 95.769413,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 19, 11, 42, 398613, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 148,
 'log_count/DEBUG': 1926,
 'log_count/INFO': 2457,
 'memusage/max': 164655104,
 'memusage/startup': 149725184,
 'request_depth_max': 23,
 'response_received_count': 24,
 'scheduler/dequeued': 24,
 'scheduler/dequeued/memory': 24,
 'scheduler/enqueued': 24,
 'scheduler/enqueued/memory': 24,
 'scrape_type/batch_skipped': 402,
 'scrape_type/price_update': 148,
 'scrape_type/skipped': 248,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 24,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.7173948692701138,
 'scrapy-zyte-api/mean_response_seconds': 2.857185988919809,
 'scrapy-zyte-api/processed': 24,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 24,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 23,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 24,
 'scrapy-zyte-api/request_args/httpRequestBody': 22,
 'scrapy-zyte-api/request_args/httpRequestMethod': 22,
 'scrapy-zyte-api/request_args/httpResponseBody': 24,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 24,
 'scrapy-zyte-api/request_args/sessionContext': 24,
 'scrapy-zyte-api/request_args/url': 24,
 'scrapy-zyte-api/status_codes/200': 24,
 'scrapy-zyte-api/success': 24,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 798,
 'source/total_available': 758,
 'start_time': datetime.datetime(2026, 3, 29, 19, 10, 6, 629200, tzinfo=datetime.timezone.utc)}
2026-03-29 19:11:42 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 19:11:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f49e7aa6310>
2026-03-29 19:11:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f49e7bcff90>