2026-03-30 05:10:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 05:10:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 05:10:06 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-30 05:10:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-30 05:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 05:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 05:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 05:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 05:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: 46a98557d29330e7
2026-03-30 05:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 05:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-30T05_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 05:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 05:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 05:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 05:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 05:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 05:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 05:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 05:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 05:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 05:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 05:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 05:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 05:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 05:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 05:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 05:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 05:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 05:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 05:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-30 05:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 05:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 05:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 05:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 05:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 05:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 05:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 05:10:40 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 758 | hits on page: 40
2026-03-30 05:10:40 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-30 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-30 05:10:40 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-30 05:10:40 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-30 05:10:40 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 05:10:40 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-30 05:10:40 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-30 05:10:40 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-30 05:10:40 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-30 05:10:40 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-30 05:10:40 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-30 05:10:40 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for XW90615: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for KJ03037: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for YC94295: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for PE07058: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW98362%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for BW98362: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for ZP63684: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for VL80205: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for FD56899: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for FJ96412: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF19474%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for YF19474: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for CN90357: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for JG60699: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for ZJ02157: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for GX78126: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for ME06294: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN80164%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for NN80164: 0
2026-03-30 05:10:41 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-30 05:10:41 [auto1.nl] INFO: Scrape type for AW61305: 0
2026-03-30 05:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:11:01 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 758 | hits on page: 40
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for XW90615: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for KJ03037: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for YC94295: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for PE07058: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW98362%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for BW98362: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for ZP63684: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for VL80205: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for FD56899: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for FJ96412: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF19474%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for YF19474: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for CN90357: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for JG60699: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for ZJ02157: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX78126%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for GX78126: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for ME06294: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN80164%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for NN80164: 0
2026-03-30 05:11:01 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-30 05:11:01 [auto1.nl] INFO: Scrape type for AW61305: 0
2026-03-30 05:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:11:04 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 758 | hits on page: 40
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX02211%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for LX02211: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY24262%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for PY24262: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB25892%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for YB25892: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW76665%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for DW76665: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for JW20864: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for JZ35389: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK38734%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for RK38734: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG10005%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for KG10005: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA59748%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for NA59748: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW17095%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for XW17095: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-30 05:11:04 [auto1.nl] INFO: Scrape type for NT73578: 0
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-30 05:11:04 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MG34346%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for MG34346: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for ZE21436: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY98170%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for NY98170: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV60983%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for YV60983: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for GK27630: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC52581%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for TC52581: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC17693%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for GC17693: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME46694%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for ME46694: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD44164%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for YD44164: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX76007%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for EX76007: 0
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-30 05:11:05 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SU37312%27 HTTP/1.1" 200 None
2026-03-30 05:11:05 [auto1.nl] INFO: Scrape type for SU37312: 0
2026-03-30 05:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:11:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 6 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 05:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-30 05:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:11:09 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 758 | hits on page: 40
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for SS31744: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for GY89787: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for VL52985: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA77037%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for CA77037: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC51093%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for MC51093: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for ZL38920: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ31943%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for SZ31943: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for TU57635: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH35225%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for RH35225: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX09180%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for CX09180: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ14164%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for BZ14164: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for GD44915: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC01356%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for AC01356: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for JL68792: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP11309%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for VP11309: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for ZY88945: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for KX21734: 0
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-30 05:11:09 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR57884%27 HTTP/1.1" 200 None
2026-03-30 05:11:09 [auto1.nl] INFO: Scrape type for HR57884: 2
2026-03-30 05:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 594679ef-3f4f-5c64-a3c4-18c061a1f17e with identifier: HR57884
2026-03-30 05:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 594679ef-3f4f-5c64-a3c4-18c061a1f17e with scrape type 2
2026-03-30 05:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 594679ef-3f4f-5c64-a3c4-18c061a1f17e with scrape type 2
2026-03-30 05:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 594679ef-3f4f-5c64-a3c4-18c061a1f17e, identifier: HR57884
2026-03-30 05:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 594679ef-3f4f-5c64-a3c4-18c061a1f17e with identifier: HR57884
2026-03-30 05:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 05:11:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 05:11:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 594679ef-3f4f-5c64-a3c4-18c061a1f17e with identifier: HR57884
2026-03-30 05:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 594679ef-3f4f-5c64-a3c4-18c061a1f17e with identifier: HR57884 to the API
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:18:02Z',
 'fuel_type': 'diesel',
 'id': '594679ef-3f4f-5c64-a3c4-18c061a1f17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR57884',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 188343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-12',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2013}
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR57884%27 HTTP/1.1" 200 None
2026-03-30 05:11:10 [auto1.nl] INFO: Saving data for HR57884: {'auction_closing_time': 1774883882.0, 'created_time': 1774725026.63043, 'last_price_update_time': 1774847470.534078}
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HR57884') HTTP/1.1" 204 0
2026-03-30 05:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:11:10 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-30 05:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:11:11 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 758 | hits on page: 40
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ99279%27 HTTP/1.1" 200 None
2026-03-30 05:11:11 [auto1.nl] INFO: Scrape type for DJ99279: 0
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20154%27 HTTP/1.1" 200 None
2026-03-30 05:11:11 [auto1.nl] INFO: Scrape type for LZ20154: 0
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW21106%27 HTTP/1.1" 200 None
2026-03-30 05:11:11 [auto1.nl] INFO: Scrape type for GW21106: 0
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV89778%27 HTTP/1.1" 200 None
2026-03-30 05:11:11 [auto1.nl] INFO: Scrape type for VV89778: 0
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-30 05:11:11 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ29701%27 HTTP/1.1" 200 None
2026-03-30 05:11:11 [auto1.nl] INFO: Scrape type for XZ29701: 2
2026-03-30 05:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf99c3c-1725-5f90-ad00-8ba61533ca0e with identifier: XZ29701
2026-03-30 05:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf99c3c-1725-5f90-ad00-8ba61533ca0e with scrape type 2
2026-03-30 05:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf99c3c-1725-5f90-ad00-8ba61533ca0e with scrape type 2
2026-03-30 05:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: daf99c3c-1725-5f90-ad00-8ba61533ca0e, identifier: XZ29701
2026-03-30 05:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: daf99c3c-1725-5f90-ad00-8ba61533ca0e with identifier: XZ29701
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 05:11:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 05:11:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: daf99c3c-1725-5f90-ad00-8ba61533ca0e with identifier: XZ29701
2026-03-30 05:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: daf99c3c-1725-5f90-ad00-8ba61533ca0e with identifier: XZ29701 to the API
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:33Z',
 'fuel_type': 'petrol',
 'id': 'daf99c3c-1725-5f90-ad00-8ba61533ca0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ29701',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 239612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-13',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Innovation "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Innovation "110 Jahre"',
 'year': 2010}
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ29701%27 HTTP/1.1" 200 None
2026-03-30 05:11:12 [auto1.nl] INFO: Saving data for XZ29701: {'auction_closing_time': 1774886013.0, 'created_time': 1774725026.298514, 'last_price_update_time': 1774847472.273375}
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XZ29701') HTTP/1.1" 204 0
2026-03-30 05:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:11:12 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UM83404%27 HTTP/1.1" 200 None
2026-03-30 05:11:12 [auto1.nl] INFO: Scrape type for UM83404: 2
2026-03-30 05:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5511b9b-4aa7-5b7d-93d2-01505a00d69e with identifier: UM83404
2026-03-30 05:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5511b9b-4aa7-5b7d-93d2-01505a00d69e with scrape type 2
2026-03-30 05:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5511b9b-4aa7-5b7d-93d2-01505a00d69e with scrape type 2
2026-03-30 05:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5511b9b-4aa7-5b7d-93d2-01505a00d69e, identifier: UM83404
2026-03-30 05:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5511b9b-4aa7-5b7d-93d2-01505a00d69e with identifier: UM83404
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 05:11:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 05:11:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5511b9b-4aa7-5b7d-93d2-01505a00d69e with identifier: UM83404
2026-03-30 05:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5511b9b-4aa7-5b7d-93d2-01505a00d69e with identifier: UM83404 to the API
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:25:07Z',
 'fuel_type': 'hybrid',
 'id': 'f5511b9b-4aa7-5b7d-93d2-01505a00d69e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM83404',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 48827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 PHEV 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2020}
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UM83404%27 HTTP/1.1" 200 None
2026-03-30 05:11:13 [auto1.nl] INFO: Saving data for UM83404: {'auction_closing_time': 1774884307.0, 'created_time': 1774725025.981621, 'last_price_update_time': 1774847473.025661}
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UM83404') HTTP/1.1" 204 0
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-30 05:11:13 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-30 05:11:13 [auto1.nl] INFO: Scrape type for AR80776: 2
2026-03-30 05:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with identifier: AR80776
2026-03-30 05:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with scrape type 2
2026-03-30 05:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with scrape type 2
2026-03-30 05:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5, identifier: AR80776
2026-03-30 05:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with identifier: AR80776
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 05:11:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with identifier: AR80776
2026-03-30 05:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4efe0107-92f1-5cfc-bed7-c17f63abcfe5 with identifier: AR80776 to the API
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-30T15:35:45Z',
 'fuel_type': 'petrol',
 'id': '4efe0107-92f1-5cfc-bed7-c17f63abcfe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR80776',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 111175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-19',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-30 05:11:13 [auto1.nl] INFO: Saving data for AR80776: {'auction_closing_time': 1774884945.0, 'created_time': 1774638747.883369, 'last_price_update_time': 1774847473.586466}
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AR80776') HTTP/1.1" 204 0
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-30 05:11:13 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-30 05:11:13 [auto1.nl] INFO: Scrape type for ZR90330: 2
2026-03-30 05:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with identifier: ZR90330
2026-03-30 05:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with scrape type 2
2026-03-30 05:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with scrape type 2
2026-03-30 05:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378, identifier: ZR90330
2026-03-30 05:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with identifier: ZR90330
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 05:11:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with identifier: ZR90330
2026-03-30 05:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 818d5adf-ab9d-587a-b7ec-a2bf8ff27378 with identifier: ZR90330 to the API
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:03:38Z',
 'fuel_type': 'hybrid',
 'id': '818d5adf-ab9d-587a-b7ec-a2bf8ff27378',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR90330',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 32788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-04',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4 Classic Trim',
 'transmission': 'automatic',
 'trim': 'ALL4 Classic Trim',
 'year': 2022}
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-30 05:11:14 [auto1.nl] INFO: Saving data for ZR90330: {'auction_closing_time': 1774883018.0, 'created_time': 1774552359.521955, 'last_price_update_time': 1774847474.065849}
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR90330') HTTP/1.1" 204 0
2026-03-30 05:11:14 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-30 05:11:14 [auto1.nl] INFO: Scrape type for NV18219: 0
2026-03-30 05:11:14 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-30 05:11:14 [auto1.nl] INFO: Scrape type for SA79399: 2
2026-03-30 05:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-30 05:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10916b17-6fe9-5b28-be65-3bd62aad6713 with scrape type 2
2026-03-30 05:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10916b17-6fe9-5b28-be65-3bd62aad6713 with scrape type 2
2026-03-30 05:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 10916b17-6fe9-5b28-be65-3bd62aad6713, identifier: SA79399
2026-03-30 05:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 05:11:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-30 05:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399 to the API
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:40:32Z',
 'fuel_type': 'diesel',
 'id': '10916b17-6fe9-5b28-be65-3bd62aad6713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA79399',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 472851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-21',
 'seller_name': None,
 'title': 'Volvo V70 2.4 D Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2008}
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-30 05:11:14 [auto1.nl] INFO: Saving data for SA79399: {'auction_closing_time': 1774885232.0, 'created_time': 1773131915.949564, 'last_price_update_time': 1774847474.58277}
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA79399') HTTP/1.1" 204 0
2026-03-30 05:11:14 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-30 05:11:14 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-30 05:11:14 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-30 05:11:14 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-30 05:11:14 [auto1.nl] INFO: Scrape type for FZ85660: 2
2026-03-30 05:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d1904a1-bf39-55bf-be04-9799c574d331 with identifier: FZ85660
2026-03-30 05:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d1904a1-bf39-55bf-be04-9799c574d331 with scrape type 2
2026-03-30 05:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d1904a1-bf39-55bf-be04-9799c574d331 with scrape type 2
2026-03-30 05:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0d1904a1-bf39-55bf-be04-9799c574d331, identifier: FZ85660
2026-03-30 05:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0d1904a1-bf39-55bf-be04-9799c574d331 with identifier: FZ85660
2026-03-30 05:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0d1904a1-bf39-55bf-be04-9799c574d331 with identifier: FZ85660
2026-03-30 05:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0d1904a1-bf39-55bf-be04-9799c574d331 with identifier: FZ85660 to the API
2026-03-30 05:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:46Z',
 'fuel_type': 'diesel',
 'id': '0d1904a1-bf39-55bf-be04-9799c574d331',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ85660',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 211066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-13',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D4 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2014}
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-30 05:11:15 [auto1.nl] INFO: Saving data for FZ85660: {'auction_closing_time': 1774884826.0, 'created_time': 1774354375.849345, 'last_price_update_time': 1774847475.150092}
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FZ85660') HTTP/1.1" 204 0
2026-03-30 05:11:15 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-30 05:11:15 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-30 05:11:15 [auto1.nl] INFO: Scrape type for BN23461: 2
2026-03-30 05:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7694ef7-c492-5d5f-ad06-16544646ad0e with identifier: BN23461
2026-03-30 05:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7694ef7-c492-5d5f-ad06-16544646ad0e with scrape type 2
2026-03-30 05:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7694ef7-c492-5d5f-ad06-16544646ad0e with scrape type 2
2026-03-30 05:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7694ef7-c492-5d5f-ad06-16544646ad0e, identifier: BN23461
2026-03-30 05:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7694ef7-c492-5d5f-ad06-16544646ad0e with identifier: BN23461
2026-03-30 05:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7694ef7-c492-5d5f-ad06-16544646ad0e with identifier: BN23461
2026-03-30 05:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7694ef7-c492-5d5f-ad06-16544646ad0e with identifier: BN23461 to the API
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:25:11Z',
 'fuel_type': 'petrol',
 'id': 'e7694ef7-c492-5d5f-ad06-16544646ad0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN23461',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 476959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-30 05:11:15 [auto1.nl] INFO: Saving data for BN23461: {'auction_closing_time': 1774884311.0, 'created_time': 1774638750.590244, 'last_price_update_time': 1774847475.527663}
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN23461') HTTP/1.1" 204 0
2026-03-30 05:11:15 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-30 05:11:15 [auto1.nl] INFO: Scrape type for VD03329: 2
2026-03-30 05:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d72eb42e-28b8-5932-82c1-67dcdac8bb05 with identifier: VD03329
2026-03-30 05:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72eb42e-28b8-5932-82c1-67dcdac8bb05 with scrape type 2
2026-03-30 05:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d72eb42e-28b8-5932-82c1-67dcdac8bb05 with scrape type 2
2026-03-30 05:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d72eb42e-28b8-5932-82c1-67dcdac8bb05, identifier: VD03329
2026-03-30 05:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d72eb42e-28b8-5932-82c1-67dcdac8bb05 with identifier: VD03329
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 05:11:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d72eb42e-28b8-5932-82c1-67dcdac8bb05 with identifier: VD03329
2026-03-30 05:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d72eb42e-28b8-5932-82c1-67dcdac8bb05 with identifier: VD03329 to the API
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:51:24Z',
 'fuel_type': 'diesel',
 'id': 'd72eb42e-28b8-5932-82c1-67dcdac8bb05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD03329',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 277539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-26',
 'seller_name': None,
 'title': 'Opel Vivaro 2.5 CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2011}
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-30 05:11:16 [auto1.nl] INFO: Saving data for VD03329: {'auction_closing_time': 1774885884.0, 'created_time': 1773836758.027361, 'last_price_update_time': 1774847476.018703}
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD03329') HTTP/1.1" 204 0
2026-03-30 05:11:16 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-30 05:11:16 [auto1.nl] INFO: Scrape type for JG46150: 0
2026-03-30 05:11:16 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-30 05:11:16 [auto1.nl] INFO: Scrape type for MM65316: 2
2026-03-30 05:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d2362f-8318-57d5-8787-52a2770984d6 with identifier: MM65316
2026-03-30 05:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d2362f-8318-57d5-8787-52a2770984d6 with scrape type 2
2026-03-30 05:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d2362f-8318-57d5-8787-52a2770984d6 with scrape type 2
2026-03-30 05:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56d2362f-8318-57d5-8787-52a2770984d6, identifier: MM65316
2026-03-30 05:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56d2362f-8318-57d5-8787-52a2770984d6 with identifier: MM65316
2026-03-30 05:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56d2362f-8318-57d5-8787-52a2770984d6 with identifier: MM65316
2026-03-30 05:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56d2362f-8318-57d5-8787-52a2770984d6 with identifier: MM65316 to the API
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:03Z',
 'fuel_type': 'petrol',
 'id': '56d2362f-8318-57d5-8787-52a2770984d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM65316',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 220853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-30 05:11:16 [auto1.nl] INFO: Saving data for MM65316: {'auction_closing_time': 1774884123.0, 'created_time': 1774638626.264606, 'last_price_update_time': 1774847476.433077}
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MM65316') HTTP/1.1" 204 0
2026-03-30 05:11:16 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-30 05:11:16 [auto1.nl] INFO: Scrape type for TE70578: 2
2026-03-30 05:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42b81bb-2d73-53d6-b8cb-8ec98d05370e with identifier: TE70578
2026-03-30 05:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42b81bb-2d73-53d6-b8cb-8ec98d05370e with scrape type 2
2026-03-30 05:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b42b81bb-2d73-53d6-b8cb-8ec98d05370e with scrape type 2
2026-03-30 05:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b42b81bb-2d73-53d6-b8cb-8ec98d05370e, identifier: TE70578
2026-03-30 05:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b42b81bb-2d73-53d6-b8cb-8ec98d05370e with identifier: TE70578
2026-03-30 05:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b42b81bb-2d73-53d6-b8cb-8ec98d05370e with identifier: TE70578
2026-03-30 05:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b42b81bb-2d73-53d6-b8cb-8ec98d05370e with identifier: TE70578 to the API
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:38:09Z',
 'fuel_type': 'petrol',
 'id': 'b42b81bb-2d73-53d6-b8cb-8ec98d05370e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE70578',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 281103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-27',
 'seller_name': None,
 'title': 'Volvo XC90 2.5 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-30 05:11:16 [auto1.nl] INFO: Saving data for TE70578: {'auction_closing_time': 1774885089.0, 'created_time': 1774638675.682659, 'last_price_update_time': 1774847476.845012}
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TE70578') HTTP/1.1" 204 0
2026-03-30 05:11:16 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-30 05:11:16 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-30 05:11:16 [auto1.nl] INFO: Scrape type for WN75862: 2
2026-03-30 05:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db64347a-75d8-592c-a938-c71ad0fa23ef with identifier: WN75862
2026-03-30 05:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db64347a-75d8-592c-a938-c71ad0fa23ef with scrape type 2
2026-03-30 05:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db64347a-75d8-592c-a938-c71ad0fa23ef with scrape type 2
2026-03-30 05:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: db64347a-75d8-592c-a938-c71ad0fa23ef, identifier: WN75862
2026-03-30 05:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: db64347a-75d8-592c-a938-c71ad0fa23ef with identifier: WN75862
2026-03-30 05:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: db64347a-75d8-592c-a938-c71ad0fa23ef with identifier: WN75862
2026-03-30 05:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: db64347a-75d8-592c-a938-c71ad0fa23ef with identifier: WN75862 to the API
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:08Z',
 'fuel_type': 'petrol',
 'id': 'db64347a-75d8-592c-a938-c71ad0fa23ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN75862',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 184131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-30 05:11:17 [auto1.nl] INFO: Saving data for WN75862: {'auction_closing_time': 1774882928.0, 'created_time': 1773836978.064791, 'last_price_update_time': 1774847477.226344}
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN75862') HTTP/1.1" 204 0
2026-03-30 05:11:17 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-30 05:11:17 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-30 05:11:17 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-30 05:11:17 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-30 05:11:17 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-30 05:11:17 [auto1.nl] INFO: Scrape type for AX06352: 0
2026-03-30 05:11:17 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-30 05:11:17 [auto1.nl] INFO: Scrape type for SV00912: 0
2026-03-30 05:11:17 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-30 05:11:17 [auto1.nl] INFO: Scrape type for JN77730: 0
2026-03-30 05:11:17 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-30 05:11:17 [auto1.nl] INFO: Scrape type for YT76844: 0
2026-03-30 05:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:11:23 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 758 | hits on page: 40
2026-03-30 05:11:23 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-30 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-30 05:11:23 [auto1.nl] INFO: Scrape type for VU12203: 2
2026-03-30 05:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with identifier: VU12203
2026-03-30 05:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with scrape type 2
2026-03-30 05:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with scrape type 2
2026-03-30 05:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef, identifier: VU12203
2026-03-30 05:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with identifier: VU12203
2026-03-30 05:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with identifier: VU12203
2026-03-30 05:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 679d5a25-7a1c-53a0-a08d-a57284e6b6ef with identifier: VU12203 to the API
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:13:22Z',
 'fuel_type': 'petrol',
 'id': '679d5a25-7a1c-53a0-a08d-a57284e6b6ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU12203',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 115659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-30 05:11:24 [auto1.nl] INFO: Saving data for VU12203: {'auction_closing_time': 1774883602.0, 'created_time': 1774638755.149599, 'last_price_update_time': 1774847484.217895}
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VU12203') HTTP/1.1" 204 0
2026-03-30 05:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:11:24 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD02824%27 HTTP/1.1" 200 None
2026-03-30 05:11:24 [auto1.nl] INFO: Scrape type for XD02824: 2
2026-03-30 05:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d564dc-fabd-569c-871d-bd47aea14bed with identifier: XD02824
2026-03-30 05:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d564dc-fabd-569c-871d-bd47aea14bed with scrape type 2
2026-03-30 05:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d564dc-fabd-569c-871d-bd47aea14bed with scrape type 2
2026-03-30 05:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83d564dc-fabd-569c-871d-bd47aea14bed, identifier: XD02824
2026-03-30 05:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83d564dc-fabd-569c-871d-bd47aea14bed with identifier: XD02824
2026-03-30 05:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83d564dc-fabd-569c-871d-bd47aea14bed with identifier: XD02824
2026-03-30 05:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83d564dc-fabd-569c-871d-bd47aea14bed with identifier: XD02824 to the API
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:39:44Z',
 'fuel_type': 'petrol',
 'id': '83d564dc-fabd-569c-871d-bd47aea14bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD02824',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 168250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-28',
 'seller_name': None,
 'title': 'Ford Ka 1.3 Duratec Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD02824%27 HTTP/1.1" 200 None
2026-03-30 05:11:24 [auto1.nl] INFO: Saving data for XD02824: {'auction_closing_time': 1774885184.0, 'created_time': 1774725031.777492, 'last_price_update_time': 1774847484.684376}
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XD02824') HTTP/1.1" 204 0
2026-03-30 05:11:24 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-30 05:11:24 [auto1.nl] INFO: Scrape type for AA80905: 2
2026-03-30 05:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e66780-6b8c-5f40-af1c-304f89569daa with identifier: AA80905
2026-03-30 05:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e66780-6b8c-5f40-af1c-304f89569daa with scrape type 2
2026-03-30 05:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9e66780-6b8c-5f40-af1c-304f89569daa with scrape type 2
2026-03-30 05:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c9e66780-6b8c-5f40-af1c-304f89569daa, identifier: AA80905
2026-03-30 05:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c9e66780-6b8c-5f40-af1c-304f89569daa with identifier: AA80905
2026-03-30 05:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c9e66780-6b8c-5f40-af1c-304f89569daa with identifier: AA80905
2026-03-30 05:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c9e66780-6b8c-5f40-af1c-304f89569daa with identifier: AA80905 to the API
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'diesel',
 'id': 'c9e66780-6b8c-5f40-af1c-304f89569daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA80905',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 373760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-30',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM 12 ELX L2H1 120 Multijet',
 'transmission': 'manual',
 'trim': '12 ELX L2H1 120 Multijet',
 'year': 2008}
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-30 05:11:25 [auto1.nl] INFO: Saving data for AA80905: {'auction_closing_time': 1774884291.0, 'created_time': 1774638628.838401, 'last_price_update_time': 1774847485.085291}
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AA80905') HTTP/1.1" 204 0
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-30 05:11:25 [auto1.nl] INFO: Scrape type for TB82163: 0
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-30 05:11:25 [auto1.nl] INFO: Scrape type for SY92282: 2
2026-03-30 05:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8cdb93-fe67-5c95-88ac-6018a577b961 with identifier: SY92282
2026-03-30 05:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8cdb93-fe67-5c95-88ac-6018a577b961 with scrape type 2
2026-03-30 05:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a8cdb93-fe67-5c95-88ac-6018a577b961 with scrape type 2
2026-03-30 05:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a8cdb93-fe67-5c95-88ac-6018a577b961, identifier: SY92282
2026-03-30 05:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a8cdb93-fe67-5c95-88ac-6018a577b961 with identifier: SY92282
2026-03-30 05:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a8cdb93-fe67-5c95-88ac-6018a577b961 with identifier: SY92282
2026-03-30 05:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a8cdb93-fe67-5c95-88ac-6018a577b961 with identifier: SY92282 to the API
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:11Z',
 'fuel_type': 'petrol',
 'id': '1a8cdb93-fe67-5c95-88ac-6018a577b961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY92282',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 183866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-13',
 'seller_name': None,
 'title': 'Renault Megane 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-30 05:11:25 [auto1.nl] INFO: Saving data for SY92282: {'auction_closing_time': 1774884971.0, 'created_time': 1774638720.348761, 'last_price_update_time': 1774847485.485336}
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY92282') HTTP/1.1" 204 0
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-30 05:11:25 [auto1.nl] INFO: Scrape type for AX28541: 2
2026-03-30 05:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with identifier: AX28541
2026-03-30 05:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with scrape type 2
2026-03-30 05:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with scrape type 2
2026-03-30 05:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b6cc668-c3aa-5cb6-b872-48300bbcae77, identifier: AX28541
2026-03-30 05:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with identifier: AX28541
2026-03-30 05:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with identifier: AX28541
2026-03-30 05:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b6cc668-c3aa-5cb6-b872-48300bbcae77 with identifier: AX28541 to the API
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:15:55Z',
 'fuel_type': 'petrol',
 'id': '5b6cc668-c3aa-5cb6-b872-48300bbcae77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX28541',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 143379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-04',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2016}
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-30 05:11:25 [auto1.nl] INFO: Saving data for AX28541: {'auction_closing_time': 1774883755.0, 'created_time': 1774638708.273164, 'last_price_update_time': 1774847485.939576}
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX28541') HTTP/1.1" 204 0
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-30 05:11:25 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-30 05:11:25 [auto1.nl] INFO: Scrape type for DD48612: 2
2026-03-30 05:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98af560-be81-5282-aa67-608f4b1bef6b with identifier: DD48612
2026-03-30 05:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98af560-be81-5282-aa67-608f4b1bef6b with scrape type 2
2026-03-30 05:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98af560-be81-5282-aa67-608f4b1bef6b with scrape type 2
2026-03-30 05:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b98af560-be81-5282-aa67-608f4b1bef6b, identifier: DD48612
2026-03-30 05:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b98af560-be81-5282-aa67-608f4b1bef6b with identifier: DD48612
2026-03-30 05:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b98af560-be81-5282-aa67-608f4b1bef6b with identifier: DD48612
2026-03-30 05:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b98af560-be81-5282-aa67-608f4b1bef6b with identifier: DD48612 to the API
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:16:47Z',
 'fuel_type': 'hybrid',
 'id': 'b98af560-be81-5282-aa67-608f4b1bef6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD48612',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 75683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-11',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-30 05:11:26 [auto1.nl] INFO: Saving data for DD48612: {'auction_closing_time': 1774883807.0, 'created_time': 1773927867.357678, 'last_price_update_time': 1774847486.306382}
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DD48612') HTTP/1.1" 204 0
2026-03-30 05:11:26 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-30 05:11:26 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-30 05:11:26 [auto1.nl] INFO: Scrape type for MM08239: 2
2026-03-30 05:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa9c878c-1789-594d-82e6-fde7ff729c19 with identifier: MM08239
2026-03-30 05:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa9c878c-1789-594d-82e6-fde7ff729c19 with scrape type 2
2026-03-30 05:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa9c878c-1789-594d-82e6-fde7ff729c19 with scrape type 2
2026-03-30 05:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aa9c878c-1789-594d-82e6-fde7ff729c19, identifier: MM08239
2026-03-30 05:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aa9c878c-1789-594d-82e6-fde7ff729c19 with identifier: MM08239
2026-03-30 05:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aa9c878c-1789-594d-82e6-fde7ff729c19 with identifier: MM08239
2026-03-30 05:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aa9c878c-1789-594d-82e6-fde7ff729c19 with identifier: MM08239 to the API
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:48:52Z',
 'fuel_type': 'petrol',
 'id': 'aa9c878c-1789-594d-82e6-fde7ff729c19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM08239',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 134869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-04',
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2004}
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-30 05:11:26 [auto1.nl] INFO: Saving data for MM08239: {'auction_closing_time': 1774885732.0, 'created_time': 1774552317.733776, 'last_price_update_time': 1774847486.704256}
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MM08239') HTTP/1.1" 204 0
2026-03-30 05:11:26 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-30 05:11:26 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-30 05:11:26 [auto1.nl] INFO: Scrape type for FL02627: 2
2026-03-30 05:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with identifier: FL02627
2026-03-30 05:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with scrape type 2
2026-03-30 05:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with scrape type 2
2026-03-30 05:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab, identifier: FL02627
2026-03-30 05:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with identifier: FL02627
2026-03-30 05:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with identifier: FL02627
2026-03-30 05:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab with identifier: FL02627 to the API
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:55:31Z',
 'fuel_type': 'petrol',
 'id': '3ddfdde3-72c4-5bc3-9a9f-12c7441f24ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL02627',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 147537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'BMW 3er 320i xDrive Sport Line Shadow',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line Shadow',
 'year': 2019}
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-30 05:11:27 [auto1.nl] INFO: Saving data for FL02627: {'auction_closing_time': 1774886131.0, 'created_time': 1774552352.681602, 'last_price_update_time': 1774847487.082935}
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FL02627') HTTP/1.1" 204 0
2026-03-30 05:11:27 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-30 05:11:27 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-30 05:11:27 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-30 05:11:27 [auto1.nl] INFO: Scrape type for LC20908: 2
2026-03-30 05:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb69261-0d13-577f-b2e2-08661946640d with identifier: LC20908
2026-03-30 05:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb69261-0d13-577f-b2e2-08661946640d with scrape type 2
2026-03-30 05:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb69261-0d13-577f-b2e2-08661946640d with scrape type 2
2026-03-30 05:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: acb69261-0d13-577f-b2e2-08661946640d, identifier: LC20908
2026-03-30 05:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: acb69261-0d13-577f-b2e2-08661946640d with identifier: LC20908
2026-03-30 05:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: acb69261-0d13-577f-b2e2-08661946640d with identifier: LC20908
2026-03-30 05:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: acb69261-0d13-577f-b2e2-08661946640d with identifier: LC20908 to the API
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-30T15:42:03Z',
 'fuel_type': 'petrol',
 'id': 'acb69261-0d13-577f-b2e2-08661946640d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC20908',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 108762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-30 05:11:27 [auto1.nl] INFO: Saving data for LC20908: {'auction_closing_time': 1774885323.0, 'created_time': 1774552228.739502, 'last_price_update_time': 1774847487.598755}
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LC20908') HTTP/1.1" 204 0
2026-03-30 05:11:27 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-30 05:11:27 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-30 05:11:27 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-30 05:11:27 [auto1.nl] INFO: Scrape type for KB59261: 0
2026-03-30 05:11:27 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-30 05:11:27 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-30 05:11:27 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-30 05:11:27 [auto1.nl] INFO: Scrape type for NX76865: 2
2026-03-30 05:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with identifier: NX76865
2026-03-30 05:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with scrape type 2
2026-03-30 05:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with scrape type 2
2026-03-30 05:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134, identifier: NX76865
2026-03-30 05:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with identifier: NX76865
2026-03-30 05:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with identifier: NX76865
2026-03-30 05:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fd91b14e-41e8-5dfc-8bd2-e1eaea44f134 with identifier: NX76865 to the API
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:43:02Z',
 'fuel_type': 'diesel',
 'id': 'fd91b14e-41e8-5dfc-8bd2-e1eaea44f134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX76865',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 212567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Kia Rio 1.1 CRDi Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2013}
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-30 05:11:27 [auto1.nl] INFO: Saving data for NX76865: {'auction_closing_time': 1774885382.0, 'created_time': 1774638749.257578, 'last_price_update_time': 1774847487.985068}
2026-03-30 05:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX76865') HTTP/1.1" 204 0
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-30 05:11:28 [auto1.nl] INFO: Scrape type for MD55137: 0
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-30 05:11:28 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-30 05:11:28 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-30 05:11:28 [auto1.nl] INFO: Scrape type for SY10793: 0
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-30 05:11:28 [auto1.nl] INFO: Scrape type for MZ48021: 2
2026-03-30 05:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91678a1-1303-5772-b759-08a4a52d4674 with identifier: MZ48021
2026-03-30 05:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91678a1-1303-5772-b759-08a4a52d4674 with scrape type 2
2026-03-30 05:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a91678a1-1303-5772-b759-08a4a52d4674 with scrape type 2
2026-03-30 05:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a91678a1-1303-5772-b759-08a4a52d4674, identifier: MZ48021
2026-03-30 05:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a91678a1-1303-5772-b759-08a4a52d4674 with identifier: MZ48021
2026-03-30 05:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a91678a1-1303-5772-b759-08a4a52d4674 with identifier: MZ48021
2026-03-30 05:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a91678a1-1303-5772-b759-08a4a52d4674 with identifier: MZ48021 to the API
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:22:00Z',
 'fuel_type': 'petrol',
 'id': 'a91678a1-1303-5772-b759-08a4a52d4674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ48021',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 103859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-30 05:11:28 [auto1.nl] INFO: Saving data for MZ48021: {'auction_closing_time': 1774884120.0, 'created_time': 1774638643.840246, 'last_price_update_time': 1774847488.437035}
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ48021') HTTP/1.1" 204 0
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-30 05:11:28 [auto1.nl] INFO: Scrape type for DS36560: 2
2026-03-30 05:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with identifier: DS36560
2026-03-30 05:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with scrape type 2
2026-03-30 05:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with scrape type 2
2026-03-30 05:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2a13e86-b14b-5aeb-8cd0-8458f8db4289, identifier: DS36560
2026-03-30 05:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with identifier: DS36560
2026-03-30 05:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with identifier: DS36560
2026-03-30 05:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2a13e86-b14b-5aeb-8cd0-8458f8db4289 with identifier: DS36560 to the API
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-30T15:03:42Z',
 'fuel_type': 'petrol',
 'id': 'd2a13e86-b14b-5aeb-8cd0-8458f8db4289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS36560',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 206188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-19',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2014}
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-30 05:11:28 [auto1.nl] INFO: Saving data for DS36560: {'auction_closing_time': 1774883022.0, 'created_time': 1774552246.52262, 'last_price_update_time': 1774847488.914184}
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DS36560') HTTP/1.1" 204 0
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-30 05:11:28 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-30 05:12:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 3 pages/min), scraped 24 items (at 24 items/min)
2026-03-30 05:12:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:13:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 0 pages/min), scraped 24 items (at 0 items/min)
2026-03-30 05:13:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:13:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.226(s), this was the 1st time calling it.
2026-03-30 05:13:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.318212981876357 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 05:13:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 05:14:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 0 pages/min), scraped 24 items (at 0 items/min)
2026-03-30 05:14:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:15:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 0 pages/min), scraped 24 items (at 0 items/min)
2026-03-30 05:15:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:15:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.390(s), this was the 2nd time calling it.
2026-03-30 05:15:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.108820766734022 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 05:15:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 05:16:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 0 pages/min), scraped 24 items (at 0 items/min)
2026-03-30 05:16:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:17:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 0 pages/min), scraped 24 items (at 0 items/min)
2026-03-30 05:17:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:17:08 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 758 | hits on page: 40
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-30 05:17:08 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-30 05:17:08 [auto1.nl] INFO: Scrape type for RC74760: 0
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-30 05:17:08 [auto1.nl] INFO: Scrape type for VL07732: 0
2026-03-30 05:17:08 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-30 05:17:08 [auto1.nl] INFO: Scrape type for RX80263: 2
2026-03-30 05:17:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7576818-67f8-5e0e-a054-e78ef028fd16 with identifier: RX80263
2026-03-30 05:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7576818-67f8-5e0e-a054-e78ef028fd16 with scrape type 2
2026-03-30 05:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7576818-67f8-5e0e-a054-e78ef028fd16 with scrape type 2
2026-03-30 05:17:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7576818-67f8-5e0e-a054-e78ef028fd16, identifier: RX80263
2026-03-30 05:17:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7576818-67f8-5e0e-a054-e78ef028fd16 with identifier: RX80263
2026-03-30 05:17:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7576818-67f8-5e0e-a054-e78ef028fd16 with identifier: RX80263
2026-03-30 05:17:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7576818-67f8-5e0e-a054-e78ef028fd16 with identifier: RX80263 to the API
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:23:48Z',
 'fuel_type': 'petrol',
 'id': 'a7576818-67f8-5e0e-a054-e78ef028fd16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX80263',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 328040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-09',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-30 05:17:09 [auto1.nl] INFO: Saving data for RX80263: {'auction_closing_time': 1774884228.0, 'created_time': 1774638661.296761, 'last_price_update_time': 1774847829.057285}
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RX80263') HTTP/1.1" 204 0
2026-03-30 05:17:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:17:09 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-30 05:17:09 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-30 05:17:09 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-30 05:17:09 [auto1.nl] INFO: Scrape type for DG66253: 0
2026-03-30 05:17:09 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-30 05:17:09 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-30 05:17:09 [auto1.nl] INFO: Scrape type for GD99184: 2
2026-03-30 05:17:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 882b646f-7bf7-5945-bd5a-537463b8139c with identifier: GD99184
2026-03-30 05:17:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882b646f-7bf7-5945-bd5a-537463b8139c with scrape type 2
2026-03-30 05:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 882b646f-7bf7-5945-bd5a-537463b8139c with scrape type 2
2026-03-30 05:17:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 882b646f-7bf7-5945-bd5a-537463b8139c, identifier: GD99184
2026-03-30 05:17:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 882b646f-7bf7-5945-bd5a-537463b8139c with identifier: GD99184
2026-03-30 05:17:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 882b646f-7bf7-5945-bd5a-537463b8139c with identifier: GD99184
2026-03-30 05:17:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 882b646f-7bf7-5945-bd5a-537463b8139c with identifier: GD99184 to the API
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-30T15:38:48Z',
 'fuel_type': 'hybrid',
 'id': '882b646f-7bf7-5945-bd5a-537463b8139c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD99184',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 204820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Audi Q7 3.0 TDI e-tron quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-30 05:17:09 [auto1.nl] INFO: Saving data for GD99184: {'auction_closing_time': 1774885128.0, 'created_time': 1774638691.59228, 'last_price_update_time': 1774847829.689717}
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD99184') HTTP/1.1" 204 0
2026-03-30 05:17:09 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-30 05:17:09 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-30 05:17:09 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-30 05:17:09 [auto1.nl] INFO: Scrape type for ZP12059: 2
2026-03-30 05:17:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93f63994-d7bf-519d-8066-503aa599c4cd with identifier: ZP12059
2026-03-30 05:17:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93f63994-d7bf-519d-8066-503aa599c4cd with scrape type 2
2026-03-30 05:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93f63994-d7bf-519d-8066-503aa599c4cd with scrape type 2
2026-03-30 05:17:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 93f63994-d7bf-519d-8066-503aa599c4cd, identifier: ZP12059
2026-03-30 05:17:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 93f63994-d7bf-519d-8066-503aa599c4cd with identifier: ZP12059
2026-03-30 05:17:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 93f63994-d7bf-519d-8066-503aa599c4cd with identifier: ZP12059
2026-03-30 05:17:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 93f63994-d7bf-519d-8066-503aa599c4cd with identifier: ZP12059 to the API
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:14:23Z',
 'fuel_type': 'petrol',
 'id': '93f63994-d7bf-519d-8066-503aa599c4cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP12059',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 252448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-04',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2010}
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-30 05:17:10 [auto1.nl] INFO: Saving data for ZP12059: {'auction_closing_time': 1774883663.0, 'created_time': 1774638730.731176, 'last_price_update_time': 1774847830.08077}
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP12059') HTTP/1.1" 204 0
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-30 05:17:10 [auto1.nl] INFO: Scrape type for ML63258: 2
2026-03-30 05:17:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7922be91-5894-593d-9c3d-79be9439238a with identifier: ML63258
2026-03-30 05:17:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7922be91-5894-593d-9c3d-79be9439238a with scrape type 2
2026-03-30 05:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7922be91-5894-593d-9c3d-79be9439238a with scrape type 2
2026-03-30 05:17:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7922be91-5894-593d-9c3d-79be9439238a, identifier: ML63258
2026-03-30 05:17:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7922be91-5894-593d-9c3d-79be9439238a with identifier: ML63258
2026-03-30 05:17:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7922be91-5894-593d-9c3d-79be9439238a with identifier: ML63258
2026-03-30 05:17:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7922be91-5894-593d-9c3d-79be9439238a with identifier: ML63258 to the API
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:36:59Z',
 'fuel_type': 'petrol',
 'id': '7922be91-5894-593d-9c3d-79be9439238a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML63258',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 167714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-30 05:17:10 [auto1.nl] INFO: Saving data for ML63258: {'auction_closing_time': 1774885019.0, 'created_time': 1774552317.086741, 'last_price_update_time': 1774847830.488278}
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML63258') HTTP/1.1" 204 0
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-30 05:17:10 [auto1.nl] INFO: Scrape type for RA23366: 2
2026-03-30 05:17:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with identifier: RA23366
2026-03-30 05:17:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with scrape type 2
2026-03-30 05:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with scrape type 2
2026-03-30 05:17:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e, identifier: RA23366
2026-03-30 05:17:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with identifier: RA23366
2026-03-30 05:17:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with identifier: RA23366
2026-03-30 05:17:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dcde52df-4bb4-551d-b4c2-2b922cfa5b8e with identifier: RA23366 to the API
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:26:51Z',
 'fuel_type': 'petrol',
 'id': 'dcde52df-4bb4-551d-b4c2-2b922cfa5b8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA23366',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 246599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-22',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-30 05:17:10 [auto1.nl] INFO: Saving data for RA23366: {'auction_closing_time': 1774884411.0, 'created_time': 1774638636.218891, 'last_price_update_time': 1774847830.912265}
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RA23366') HTTP/1.1" 204 0
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-30 05:17:10 [auto1.nl] INFO: Scrape type for NX47084: 0
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-30 05:17:10 [auto1.nl] INFO: Scrape type for EY85081: 0
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-30 05:17:10 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-30 05:17:10 [auto1.nl] INFO: Scrape type for AC84495: 2
2026-03-30 05:17:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9544290a-081f-59bd-b674-d583af77271f with identifier: AC84495
2026-03-30 05:17:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9544290a-081f-59bd-b674-d583af77271f with scrape type 2
2026-03-30 05:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9544290a-081f-59bd-b674-d583af77271f with scrape type 2
2026-03-30 05:17:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9544290a-081f-59bd-b674-d583af77271f, identifier: AC84495
2026-03-30 05:17:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9544290a-081f-59bd-b674-d583af77271f with identifier: AC84495
2026-03-30 05:17:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9544290a-081f-59bd-b674-d583af77271f with identifier: AC84495
2026-03-30 05:17:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9544290a-081f-59bd-b674-d583af77271f with identifier: AC84495 to the API
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:42:25Z',
 'fuel_type': 'petrol',
 'id': '9544290a-081f-59bd-b674-d583af77271f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC84495',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 146009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-22',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Attract",
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2014}
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-30 05:17:11 [auto1.nl] INFO: Saving data for AC84495: {'auction_closing_time': 1774885345.0, 'created_time': 1773775016.690612, 'last_price_update_time': 1774847831.357487}
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AC84495') HTTP/1.1" 204 0
2026-03-30 05:17:11 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-30 05:17:11 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-30 05:17:11 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-30 05:17:11 [auto1.nl] INFO: Scrape type for FK48987: 2
2026-03-30 05:17:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with identifier: FK48987
2026-03-30 05:17:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with scrape type 2
2026-03-30 05:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with scrape type 2
2026-03-30 05:17:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be, identifier: FK48987
2026-03-30 05:17:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with identifier: FK48987
2026-03-30 05:17:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with identifier: FK48987
2026-03-30 05:17:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14c57f01-983c-512a-b7b3-5cd8f8a8a0be with identifier: FK48987 to the API
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:02:34Z',
 'fuel_type': 'petrol',
 'id': '14c57f01-983c-512a-b7b3-5cd8f8a8a0be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK48987',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 232858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-19',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-30 05:17:11 [auto1.nl] INFO: Saving data for FK48987: {'auction_closing_time': 1774882954.0, 'created_time': 1774638751.23639, 'last_price_update_time': 1774847831.851066}
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK48987') HTTP/1.1" 204 0
2026-03-30 05:17:11 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-30 05:17:11 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-30 05:17:11 [auto1.nl] INFO: Scrape type for MD18353: 2
2026-03-30 05:17:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with identifier: MD18353
2026-03-30 05:17:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with scrape type 2
2026-03-30 05:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with scrape type 2
2026-03-30 05:17:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 505ee203-78d9-5301-bcdb-ba3c49c27bb0, identifier: MD18353
2026-03-30 05:17:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with identifier: MD18353
2026-03-30 05:17:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with identifier: MD18353
2026-03-30 05:17:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 505ee203-78d9-5301-bcdb-ba3c49c27bb0 with identifier: MD18353 to the API
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-30T15:03:21Z',
 'fuel_type': 'petrol',
 'id': '505ee203-78d9-5301-bcdb-ba3c49c27bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD18353',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 67606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-30 05:17:12 [auto1.nl] INFO: Saving data for MD18353: {'auction_closing_time': 1774883001.0, 'created_time': 1774354364.734831, 'last_price_update_time': 1774847832.284265}
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD18353') HTTP/1.1" 204 0
2026-03-30 05:17:12 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-30 05:17:12 [auto1.nl] INFO: Scrape type for FP18275: 0
2026-03-30 05:17:12 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-30 05:17:12 [auto1.nl] INFO: Scrape type for BV58634: 0
2026-03-30 05:17:12 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-30 05:17:12 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-30 05:17:12 [auto1.nl] INFO: Scrape type for JM47469: 0
2026-03-30 05:17:12 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-30 05:17:12 [auto1.nl] INFO: Scrape type for FL63517: 2
2026-03-30 05:17:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06cde6ab-138c-552f-99a1-d0985008df27 with identifier: FL63517
2026-03-30 05:17:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06cde6ab-138c-552f-99a1-d0985008df27 with scrape type 2
2026-03-30 05:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06cde6ab-138c-552f-99a1-d0985008df27 with scrape type 2
2026-03-30 05:17:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 06cde6ab-138c-552f-99a1-d0985008df27, identifier: FL63517
2026-03-30 05:17:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 06cde6ab-138c-552f-99a1-d0985008df27 with identifier: FL63517
2026-03-30 05:17:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 06cde6ab-138c-552f-99a1-d0985008df27 with identifier: FL63517
2026-03-30 05:17:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 06cde6ab-138c-552f-99a1-d0985008df27 with identifier: FL63517 to the API
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:12:42Z',
 'fuel_type': 'petrol',
 'id': '06cde6ab-138c-552f-99a1-d0985008df27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL63517',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 226687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-25',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 X-Line',
 'transmission': 'manual',
 'trim': 'X-Line',
 'year': 2008}
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-30 05:17:12 [auto1.nl] INFO: Saving data for FL63517: {'auction_closing_time': 1774883562.0, 'created_time': 1774638759.655289, 'last_price_update_time': 1774847832.733954}
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FL63517') HTTP/1.1" 204 0
2026-03-30 05:17:12 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-30 05:17:12 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-30 05:17:12 [auto1.nl] INFO: Scrape type for BM96536: 2
2026-03-30 05:17:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3862e252-f0ce-50cc-a3da-a91b54671470 with identifier: BM96536
2026-03-30 05:17:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3862e252-f0ce-50cc-a3da-a91b54671470 with scrape type 2
2026-03-30 05:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3862e252-f0ce-50cc-a3da-a91b54671470 with scrape type 2
2026-03-30 05:17:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3862e252-f0ce-50cc-a3da-a91b54671470, identifier: BM96536
2026-03-30 05:17:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3862e252-f0ce-50cc-a3da-a91b54671470 with identifier: BM96536
2026-03-30 05:17:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3862e252-f0ce-50cc-a3da-a91b54671470 with identifier: BM96536
2026-03-30 05:17:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3862e252-f0ce-50cc-a3da-a91b54671470 with identifier: BM96536 to the API
2026-03-30 05:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:43Z',
 'fuel_type': 'diesel',
 'id': '3862e252-f0ce-50cc-a3da-a91b54671470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM96536',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 117028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-30 05:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-30 05:17:13 [auto1.nl] INFO: Saving data for BM96536: {'auction_closing_time': 1774885663.0, 'created_time': 1774552320.067762, 'last_price_update_time': 1774847833.111445}
2026-03-30 05:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM96536') HTTP/1.1" 204 0
2026-03-30 05:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:17:26 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 758 | hits on page: 40
2026-03-30 05:17:26 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-30 05:17:26 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-30 05:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-30 05:17:26 [auto1.nl] INFO: Scrape type for WP95967: 2
2026-03-30 05:17:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc898ff4-2139-54fa-9dd0-de35a68bd729 with identifier: WP95967
2026-03-30 05:17:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc898ff4-2139-54fa-9dd0-de35a68bd729 with scrape type 2
2026-03-30 05:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc898ff4-2139-54fa-9dd0-de35a68bd729 with scrape type 2
2026-03-30 05:17:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cc898ff4-2139-54fa-9dd0-de35a68bd729, identifier: WP95967
2026-03-30 05:17:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cc898ff4-2139-54fa-9dd0-de35a68bd729 with identifier: WP95967
2026-03-30 05:17:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cc898ff4-2139-54fa-9dd0-de35a68bd729 with identifier: WP95967
2026-03-30 05:17:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cc898ff4-2139-54fa-9dd0-de35a68bd729 with identifier: WP95967 to the API
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:12:25Z',
 'fuel_type': 'petrol',
 'id': 'cc898ff4-2139-54fa-9dd0-de35a68bd729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP95967',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 243194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-01',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Summum 2WD',
 'transmission': 'automatic',
 'trim': 'Summum 2WD',
 'year': 2014}
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-30 05:17:27 [auto1.nl] INFO: Saving data for WP95967: {'auction_closing_time': 1774883545.0, 'created_time': 1774638767.142634, 'last_price_update_time': 1774847847.217263}
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WP95967') HTTP/1.1" 204 0
2026-03-30 05:17:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-30 05:17:27 [auto1.nl] INFO: Scrape type for ZL63379: 0
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW60386%27 HTTP/1.1" 200 None
2026-03-30 05:17:27 [auto1.nl] INFO: Scrape type for MW60386: 0
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-30 05:17:27 [auto1.nl] INFO: Scrape type for CM00428: 2
2026-03-30 05:17:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbaa6dcc-244c-5a8b-8537-0b65678867ce with identifier: CM00428
2026-03-30 05:17:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbaa6dcc-244c-5a8b-8537-0b65678867ce with scrape type 2
2026-03-30 05:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbaa6dcc-244c-5a8b-8537-0b65678867ce with scrape type 2
2026-03-30 05:17:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fbaa6dcc-244c-5a8b-8537-0b65678867ce, identifier: CM00428
2026-03-30 05:17:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fbaa6dcc-244c-5a8b-8537-0b65678867ce with identifier: CM00428
2026-03-30 05:17:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fbaa6dcc-244c-5a8b-8537-0b65678867ce with identifier: CM00428
2026-03-30 05:17:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fbaa6dcc-244c-5a8b-8537-0b65678867ce with identifier: CM00428 to the API
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:00:12Z',
 'fuel_type': 'petrol',
 'id': 'fbaa6dcc-244c-5a8b-8537-0b65678867ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM00428',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 89052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-18',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up! BlueMotion',
 'transmission': 'manual',
 'trim': 'Move  BlueMotion',
 'year': 2017}
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-30 05:17:27 [auto1.nl] INFO: Saving data for CM00428: {'auction_closing_time': 1774882812.0, 'created_time': 1774638743.219328, 'last_price_update_time': 1774847847.661668}
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM00428') HTTP/1.1" 204 0
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-30 05:17:27 [auto1.nl] INFO: Scrape type for FJ00169: 0
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-30 05:17:27 [auto1.nl] INFO: Scrape type for GP63449: 0
2026-03-30 05:17:27 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-30 05:17:27 [auto1.nl] INFO: Scrape type for BZ75535: 2
2026-03-30 05:17:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88555a79-79bd-5269-bd22-a9bbeac100f4 with identifier: BZ75535
2026-03-30 05:17:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88555a79-79bd-5269-bd22-a9bbeac100f4 with scrape type 2
2026-03-30 05:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88555a79-79bd-5269-bd22-a9bbeac100f4 with scrape type 2
2026-03-30 05:17:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 88555a79-79bd-5269-bd22-a9bbeac100f4, identifier: BZ75535
2026-03-30 05:17:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 88555a79-79bd-5269-bd22-a9bbeac100f4 with identifier: BZ75535
2026-03-30 05:17:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 88555a79-79bd-5269-bd22-a9bbeac100f4 with identifier: BZ75535
2026-03-30 05:17:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 88555a79-79bd-5269-bd22-a9bbeac100f4 with identifier: BZ75535 to the API
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:53:46Z',
 'fuel_type': 'diesel',
 'id': '88555a79-79bd-5269-bd22-a9bbeac100f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ75535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 225365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-29',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Carat BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat BlueMotion',
 'year': 2014}
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-30 05:17:28 [auto1.nl] INFO: Saving data for BZ75535: {'auction_closing_time': 1774886026.0, 'created_time': 1774552343.744415, 'last_price_update_time': 1774847848.101124}
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ75535') HTTP/1.1" 204 0
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-30 05:17:28 [auto1.nl] INFO: Scrape type for PE89486: 2
2026-03-30 05:17:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with identifier: PE89486
2026-03-30 05:17:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with scrape type 2
2026-03-30 05:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with scrape type 2
2026-03-30 05:17:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4, identifier: PE89486
2026-03-30 05:17:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with identifier: PE89486
2026-03-30 05:17:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with identifier: PE89486
2026-03-30 05:17:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4 with identifier: PE89486 to the API
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:31:18Z',
 'fuel_type': 'petrol',
 'id': '3ecc9ed4-8357-5009-a7e4-ef1142d1f1c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE89486',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 122397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-14',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-30 05:17:28 [auto1.nl] INFO: Saving data for PE89486: {'auction_closing_time': 1774884678.0, 'created_time': 1773947586.840336, 'last_price_update_time': 1774847848.593508}
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PE89486') HTTP/1.1" 204 0
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-30 05:17:28 [auto1.nl] INFO: Scrape type for CR31925: 0
2026-03-30 05:17:28 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-30 05:17:28 [auto1.nl] INFO: Scrape type for UR99157: 2
2026-03-30 05:17:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with identifier: UR99157
2026-03-30 05:17:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with scrape type 2
2026-03-30 05:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with scrape type 2
2026-03-30 05:17:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 93ae1b95-53f2-5f14-81ad-40956a1b60a3, identifier: UR99157
2026-03-30 05:17:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with identifier: UR99157
2026-03-30 05:17:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with identifier: UR99157
2026-03-30 05:17:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 93ae1b95-53f2-5f14-81ad-40956a1b60a3 with identifier: UR99157 to the API
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:25:35Z',
 'fuel_type': 'petrol',
 'id': '93ae1b95-53f2-5f14-81ad-40956a1b60a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR99157',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 85811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-30',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Motion",
 'transmission': 'manual',
 'trim': 'Motion',
 'year': 2022}
2026-03-30 05:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-30 05:17:29 [auto1.nl] INFO: Saving data for UR99157: {'auction_closing_time': 1774884335.0, 'created_time': 1774638737.977021, 'last_price_update_time': 1774847849.004111}
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR99157') HTTP/1.1" 204 0
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-30 05:17:29 [auto1.nl] INFO: Scrape type for ZX00670: 0
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-30 05:17:29 [auto1.nl] INFO: Scrape type for NP69601: 2
2026-03-30 05:17:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with identifier: NP69601
2026-03-30 05:17:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with scrape type 2
2026-03-30 05:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with scrape type 2
2026-03-30 05:17:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5, identifier: NP69601
2026-03-30 05:17:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with identifier: NP69601
2026-03-30 05:17:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with identifier: NP69601
2026-03-30 05:17:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ad582fe-f4e2-5151-8e99-d87f1f5be2d5 with identifier: NP69601 to the API
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:25:16Z',
 'fuel_type': 'petrol',
 'id': '7ad582fe-f4e2-5151-8e99-d87f1f5be2d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP69601',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 38446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-15',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-30 05:17:29 [auto1.nl] INFO: Saving data for NP69601: {'auction_closing_time': 1774884316.0, 'created_time': 1774638761.80171, 'last_price_update_time': 1774847849.411576}
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NP69601') HTTP/1.1" 204 0
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-30 05:17:29 [auto1.nl] INFO: Scrape type for SR40415: 2
2026-03-30 05:17:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3c6587-1162-5844-87ae-90104e8d392d with identifier: SR40415
2026-03-30 05:17:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3c6587-1162-5844-87ae-90104e8d392d with scrape type 2
2026-03-30 05:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de3c6587-1162-5844-87ae-90104e8d392d with scrape type 2
2026-03-30 05:17:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: de3c6587-1162-5844-87ae-90104e8d392d, identifier: SR40415
2026-03-30 05:17:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: de3c6587-1162-5844-87ae-90104e8d392d with identifier: SR40415
2026-03-30 05:17:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: de3c6587-1162-5844-87ae-90104e8d392d with identifier: SR40415
2026-03-30 05:17:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: de3c6587-1162-5844-87ae-90104e8d392d with identifier: SR40415 to the API
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:08:47Z',
 'fuel_type': 'petrol',
 'id': 'de3c6587-1162-5844-87ae-90104e8d392d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR40415',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 108978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-22',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2013}
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-30 05:17:29 [auto1.nl] INFO: Saving data for SR40415: {'auction_closing_time': 1774883327.0, 'created_time': 1774638638.757295, 'last_price_update_time': 1774847849.886907}
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SR40415') HTTP/1.1" 204 0
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-30 05:17:29 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-30 05:17:29 [auto1.nl] INFO: Scrape type for NR15886: 2
2026-03-30 05:17:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dad77f45-1ffc-5939-8aaf-1a5047447fff with identifier: NR15886
2026-03-30 05:17:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad77f45-1ffc-5939-8aaf-1a5047447fff with scrape type 2
2026-03-30 05:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dad77f45-1ffc-5939-8aaf-1a5047447fff with scrape type 2
2026-03-30 05:17:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dad77f45-1ffc-5939-8aaf-1a5047447fff, identifier: NR15886
2026-03-30 05:17:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dad77f45-1ffc-5939-8aaf-1a5047447fff with identifier: NR15886
2026-03-30 05:17:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dad77f45-1ffc-5939-8aaf-1a5047447fff with identifier: NR15886
2026-03-30 05:17:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dad77f45-1ffc-5939-8aaf-1a5047447fff with identifier: NR15886 to the API
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'petrol',
 'id': 'dad77f45-1ffc-5939-8aaf-1a5047447fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR15886',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 290691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-15',
 'seller_name': None,
 'title': 'Kia Rio 1.4 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2008}
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-30 05:17:30 [auto1.nl] INFO: Saving data for NR15886: {'auction_closing_time': 1774885654.0, 'created_time': 1774638762.874887, 'last_price_update_time': 1774847850.286595}
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR15886') HTTP/1.1" 204 0
2026-03-30 05:17:30 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-30 05:17:30 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-30 05:17:30 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-30 05:17:30 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-30 05:17:30 [auto1.nl] INFO: Scrape type for FL22944: 2
2026-03-30 05:17:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0191c7b-337f-58ba-829a-01ab6fb3759f with identifier: FL22944
2026-03-30 05:17:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0191c7b-337f-58ba-829a-01ab6fb3759f with scrape type 2
2026-03-30 05:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0191c7b-337f-58ba-829a-01ab6fb3759f with scrape type 2
2026-03-30 05:17:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c0191c7b-337f-58ba-829a-01ab6fb3759f, identifier: FL22944
2026-03-30 05:17:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c0191c7b-337f-58ba-829a-01ab6fb3759f with identifier: FL22944
2026-03-30 05:17:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c0191c7b-337f-58ba-829a-01ab6fb3759f with identifier: FL22944
2026-03-30 05:17:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c0191c7b-337f-58ba-829a-01ab6fb3759f with identifier: FL22944 to the API
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:35:28Z',
 'fuel_type': 'diesel',
 'id': 'c0191c7b-337f-58ba-829a-01ab6fb3759f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL22944',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 298627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2010}
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-30 05:17:30 [auto1.nl] INFO: Saving data for FL22944: {'auction_closing_time': 1774884928.0, 'created_time': 1774552237.912237, 'last_price_update_time': 1774847850.737044}
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FL22944') HTTP/1.1" 204 0
2026-03-30 05:17:30 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-30 05:17:30 [auto1.nl] INFO: Scrape type for ME98271: 2
2026-03-30 05:17:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9322357-e6fb-5984-9120-59bbfc3ba07c with identifier: ME98271
2026-03-30 05:17:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9322357-e6fb-5984-9120-59bbfc3ba07c with scrape type 2
2026-03-30 05:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9322357-e6fb-5984-9120-59bbfc3ba07c with scrape type 2
2026-03-30 05:17:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a9322357-e6fb-5984-9120-59bbfc3ba07c, identifier: ME98271
2026-03-30 05:17:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a9322357-e6fb-5984-9120-59bbfc3ba07c with identifier: ME98271
2026-03-30 05:17:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a9322357-e6fb-5984-9120-59bbfc3ba07c with identifier: ME98271
2026-03-30 05:17:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a9322357-e6fb-5984-9120-59bbfc3ba07c with identifier: ME98271 to the API
2026-03-30 05:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:05:46Z',
 'fuel_type': 'petrol',
 'id': 'a9322357-e6fb-5984-9120-59bbfc3ba07c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME98271',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 147929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-25',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Crossborder',
 'transmission': 'automatic',
 'trim': 'Crossborder',
 'year': 2017}
2026-03-30 05:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-30 05:17:31 [auto1.nl] INFO: Saving data for ME98271: {'auction_closing_time': 1774883146.0, 'created_time': 1774552312.515774, 'last_price_update_time': 1774847851.531155}
2026-03-30 05:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME98271') HTTP/1.1" 204 0
2026-03-30 05:17:31 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-30 05:17:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:17:34 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 758 | hits on page: 40
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-30 05:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-30 05:17:34 [auto1.nl] INFO: Scrape type for CK43593: 0
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-30 05:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-30 05:17:34 [auto1.nl] INFO: Scrape type for SV78620: 0
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-30 05:17:34 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-30 05:17:35 [auto1.nl] INFO: Scrape type for YZ85937: 0
2026-03-30 05:17:35 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-30 05:17:35 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-30 05:17:35 [auto1.nl] INFO: Scrape type for UY18740: 2
2026-03-30 05:17:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8cc57e7-24d1-55b6-a939-72e59a9813d1 with identifier: UY18740
2026-03-30 05:17:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cc57e7-24d1-55b6-a939-72e59a9813d1 with scrape type 2
2026-03-30 05:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8cc57e7-24d1-55b6-a939-72e59a9813d1 with scrape type 2
2026-03-30 05:17:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f8cc57e7-24d1-55b6-a939-72e59a9813d1, identifier: UY18740
2026-03-30 05:17:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f8cc57e7-24d1-55b6-a939-72e59a9813d1 with identifier: UY18740
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 05:17:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:17:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f8cc57e7-24d1-55b6-a939-72e59a9813d1 with identifier: UY18740
2026-03-30 05:17:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f8cc57e7-24d1-55b6-a939-72e59a9813d1 with identifier: UY18740 to the API
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:20:59Z',
 'fuel_type': 'petrol',
 'id': 'f8cc57e7-24d1-55b6-a939-72e59a9813d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY18740',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 176542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-23',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 LX',
 'transmission': 'manual',
 'trim': 'LX',
 'year': 2004}
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-30 05:17:35 [auto1.nl] INFO: Saving data for UY18740: {'auction_closing_time': 1774884059.0, 'created_time': 1774638748.630016, 'last_price_update_time': 1774847855.521748}
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY18740') HTTP/1.1" 204 0
2026-03-30 05:17:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:17:35 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-30 05:17:35 [auto1.nl] INFO: Scrape type for MZ50492: 2
2026-03-30 05:17:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b4421b8-dfae-511a-a22e-7e9f721f738c with identifier: MZ50492
2026-03-30 05:17:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b4421b8-dfae-511a-a22e-7e9f721f738c with scrape type 2
2026-03-30 05:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b4421b8-dfae-511a-a22e-7e9f721f738c with scrape type 2
2026-03-30 05:17:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b4421b8-dfae-511a-a22e-7e9f721f738c, identifier: MZ50492
2026-03-30 05:17:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b4421b8-dfae-511a-a22e-7e9f721f738c with identifier: MZ50492
2026-03-30 05:17:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b4421b8-dfae-511a-a22e-7e9f721f738c with identifier: MZ50492
2026-03-30 05:17:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b4421b8-dfae-511a-a22e-7e9f721f738c with identifier: MZ50492 to the API
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:29:13Z',
 'fuel_type': 'diesel',
 'id': '8b4421b8-dfae-511a-a22e-7e9f721f738c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ50492',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 198186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-18',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-30 05:17:35 [auto1.nl] INFO: Saving data for MZ50492: {'auction_closing_time': 1774884553.0, 'created_time': 1774638756.271681, 'last_price_update_time': 1774847855.983906}
2026-03-30 05:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ50492') HTTP/1.1" 204 0
2026-03-30 05:17:36 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-30 05:17:36 [auto1.nl] INFO: Scrape type for UJ05110: 2
2026-03-30 05:17:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with identifier: UJ05110
2026-03-30 05:17:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with scrape type 2
2026-03-30 05:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with scrape type 2
2026-03-30 05:17:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05, identifier: UJ05110
2026-03-30 05:17:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with identifier: UJ05110
2026-03-30 05:17:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with identifier: UJ05110
2026-03-30 05:17:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05 with identifier: UJ05110 to the API
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:52:25Z',
 'fuel_type': 'petrol',
 'id': 'bc8f75c5-21a9-56a9-8ffb-d3e05f9f9b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ05110',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Getz',
 'odometer': 172253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-28',
 'seller_name': None,
 'title': 'Hyundai Getz 1.3 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2004}
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-30 05:17:36 [auto1.nl] INFO: Saving data for UJ05110: {'auction_closing_time': 1774885945.0, 'created_time': 1774638765.298375, 'last_price_update_time': 1774847856.366037}
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ05110') HTTP/1.1" 204 0
2026-03-30 05:17:36 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-30 05:17:36 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-30 05:17:36 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-30 05:17:36 [auto1.nl] INFO: Scrape type for XG57923: 2
2026-03-30 05:17:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c517fe9b-161c-538b-8fbc-45fcd2968086 with identifier: XG57923
2026-03-30 05:17:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c517fe9b-161c-538b-8fbc-45fcd2968086 with scrape type 2
2026-03-30 05:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c517fe9b-161c-538b-8fbc-45fcd2968086 with scrape type 2
2026-03-30 05:17:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c517fe9b-161c-538b-8fbc-45fcd2968086, identifier: XG57923
2026-03-30 05:17:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c517fe9b-161c-538b-8fbc-45fcd2968086 with identifier: XG57923
2026-03-30 05:17:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c517fe9b-161c-538b-8fbc-45fcd2968086 with identifier: XG57923
2026-03-30 05:17:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c517fe9b-161c-538b-8fbc-45fcd2968086 with identifier: XG57923 to the API
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:29Z',
 'fuel_type': 'petrol',
 'id': 'c517fe9b-161c-538b-8fbc-45fcd2968086',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG57923',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 313070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Volvo V40 2.0 T4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2018}
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-30 05:17:36 [auto1.nl] INFO: Saving data for XG57923: {'auction_closing_time': 1774885709.0, 'created_time': 1774552260.008821, 'last_price_update_time': 1774847856.759887}
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XG57923') HTTP/1.1" 204 0
2026-03-30 05:17:36 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-30 05:17:36 [auto1.nl] INFO: Scrape type for RP15329: 0
2026-03-30 05:17:36 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-30 05:17:36 [auto1.nl] INFO: Scrape type for VM41876: 0
2026-03-30 05:17:36 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-30 05:17:36 [auto1.nl] INFO: Scrape type for FH34143: 2
2026-03-30 05:17:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cd15db4-78ce-5830-b708-07165c5c9b05 with identifier: FH34143
2026-03-30 05:17:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cd15db4-78ce-5830-b708-07165c5c9b05 with scrape type 2
2026-03-30 05:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cd15db4-78ce-5830-b708-07165c5c9b05 with scrape type 2
2026-03-30 05:17:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9cd15db4-78ce-5830-b708-07165c5c9b05, identifier: FH34143
2026-03-30 05:17:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9cd15db4-78ce-5830-b708-07165c5c9b05 with identifier: FH34143
2026-03-30 05:17:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9cd15db4-78ce-5830-b708-07165c5c9b05 with identifier: FH34143
2026-03-30 05:17:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9cd15db4-78ce-5830-b708-07165c5c9b05 with identifier: FH34143 to the API
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:13:49Z',
 'fuel_type': 'petrol',
 'id': '9cd15db4-78ce-5830-b708-07165c5c9b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH34143',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 132652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-18',
 'seller_name': None,
 'title': 'BMW 2er 225i Active Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-30 05:17:37 [auto1.nl] INFO: Saving data for FH34143: {'auction_closing_time': 1774883629.0, 'created_time': 1774638636.763636, 'last_price_update_time': 1774847857.183177}
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH34143') HTTP/1.1" 204 0
2026-03-30 05:17:37 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-30 05:17:37 [auto1.nl] INFO: Scrape type for FW39949: 2
2026-03-30 05:17:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6702191a-6f19-59d0-9093-d15b6bfd9f50 with identifier: FW39949
2026-03-30 05:17:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6702191a-6f19-59d0-9093-d15b6bfd9f50 with scrape type 2
2026-03-30 05:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6702191a-6f19-59d0-9093-d15b6bfd9f50 with scrape type 2
2026-03-30 05:17:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6702191a-6f19-59d0-9093-d15b6bfd9f50, identifier: FW39949
2026-03-30 05:17:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6702191a-6f19-59d0-9093-d15b6bfd9f50 with identifier: FW39949
2026-03-30 05:17:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6702191a-6f19-59d0-9093-d15b6bfd9f50 with identifier: FW39949
2026-03-30 05:17:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6702191a-6f19-59d0-9093-d15b6bfd9f50 with identifier: FW39949 to the API
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:20:55Z',
 'fuel_type': 'petrol',
 'id': '6702191a-6f19-59d0-9093-d15b6bfd9f50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW39949',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 101520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-30 05:17:37 [auto1.nl] INFO: Saving data for FW39949: {'auction_closing_time': 1774884055.0, 'created_time': 1774638726.044862, 'last_price_update_time': 1774847857.585111}
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FW39949') HTTP/1.1" 204 0
2026-03-30 05:17:37 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-30 05:17:37 [auto1.nl] INFO: Scrape type for ZP69271: 0
2026-03-30 05:17:37 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-30 05:17:37 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-30 05:17:37 [auto1.nl] INFO: Scrape type for BY94157: 2
2026-03-30 05:17:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with identifier: BY94157
2026-03-30 05:17:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with scrape type 2
2026-03-30 05:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with scrape type 2
2026-03-30 05:17:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034, identifier: BY94157
2026-03-30 05:17:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with identifier: BY94157
2026-03-30 05:17:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with identifier: BY94157
2026-03-30 05:17:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 317d27cd-5c43-5cde-9d4e-1b1fdd7da034 with identifier: BY94157 to the API
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:26Z',
 'fuel_type': 'diesel',
 'id': '317d27cd-5c43-5cde-9d4e-1b1fdd7da034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY94157',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 262999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-10',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Niveau A L1',
 'transmission': 'manual',
 'trim': 'Niveau A L1',
 'year': 2009}
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-30 05:17:37 [auto1.nl] INFO: Saving data for BY94157: {'auction_closing_time': 1774883726.0, 'created_time': 1774638746.640204, 'last_price_update_time': 1774847857.984649}
2026-03-30 05:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY94157') HTTP/1.1" 204 0
2026-03-30 05:17:38 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-30 05:17:38 [auto1.nl] INFO: Scrape type for JK88621: 2
2026-03-30 05:17:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2ffd782-cdd8-5b4e-8f07-452f43cee333 with identifier: JK88621
2026-03-30 05:17:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2ffd782-cdd8-5b4e-8f07-452f43cee333 with scrape type 2
2026-03-30 05:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2ffd782-cdd8-5b4e-8f07-452f43cee333 with scrape type 2
2026-03-30 05:17:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a2ffd782-cdd8-5b4e-8f07-452f43cee333, identifier: JK88621
2026-03-30 05:17:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a2ffd782-cdd8-5b4e-8f07-452f43cee333 with identifier: JK88621
2026-03-30 05:17:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a2ffd782-cdd8-5b4e-8f07-452f43cee333 with identifier: JK88621
2026-03-30 05:17:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a2ffd782-cdd8-5b4e-8f07-452f43cee333 with identifier: JK88621 to the API
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:24Z',
 'fuel_type': 'petrol',
 'id': 'a2ffd782-cdd8-5b4e-8f07-452f43cee333',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK88621',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 126720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-01',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2009}
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-30 05:17:38 [auto1.nl] INFO: Saving data for JK88621: {'auction_closing_time': 1774882944.0, 'created_time': 1774552323.677408, 'last_price_update_time': 1774847858.460764}
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK88621') HTTP/1.1" 204 0
2026-03-30 05:17:38 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-30 05:17:38 [auto1.nl] INFO: Scrape type for VD56637: 0
2026-03-30 05:17:38 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-30 05:17:38 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-30 05:17:38 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-30 05:17:38 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-30 05:17:38 [auto1.nl] INFO: Scrape type for YK98733: 2
2026-03-30 05:17:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with identifier: YK98733
2026-03-30 05:17:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with scrape type 2
2026-03-30 05:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with scrape type 2
2026-03-30 05:17:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b54801e-7750-5838-a4bc-1b09cb88f8c8, identifier: YK98733
2026-03-30 05:17:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with identifier: YK98733
2026-03-30 05:17:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with identifier: YK98733
2026-03-30 05:17:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b54801e-7750-5838-a4bc-1b09cb88f8c8 with identifier: YK98733 to the API
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:42:25Z',
 'fuel_type': 'petrol',
 'id': '6b54801e-7750-5838-a4bc-1b09cb88f8c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK98733',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 153997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-24',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-30 05:17:38 [auto1.nl] INFO: Saving data for YK98733: {'auction_closing_time': 1774885345.0, 'created_time': 1774552235.174993, 'last_price_update_time': 1774847858.92991}
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YK98733') HTTP/1.1" 204 0
2026-03-30 05:17:38 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-30 05:17:38 [auto1.nl] INFO: Scrape type for XD61678: 2
2026-03-30 05:17:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5745546f-60dd-5830-9c19-34acea5756c7 with identifier: XD61678
2026-03-30 05:17:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5745546f-60dd-5830-9c19-34acea5756c7 with scrape type 2
2026-03-30 05:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5745546f-60dd-5830-9c19-34acea5756c7 with scrape type 2
2026-03-30 05:17:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5745546f-60dd-5830-9c19-34acea5756c7, identifier: XD61678
2026-03-30 05:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:17:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5745546f-60dd-5830-9c19-34acea5756c7 with identifier: XD61678
2026-03-30 05:17:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5745546f-60dd-5830-9c19-34acea5756c7 with identifier: XD61678
2026-03-30 05:17:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5745546f-60dd-5830-9c19-34acea5756c7 with identifier: XD61678 to the API
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:43:02Z',
 'fuel_type': 'petrol',
 'id': '5745546f-60dd-5830-9c19-34acea5756c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD61678',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 251536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2014}
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-30 05:17:39 [auto1.nl] INFO: Saving data for XD61678: {'auction_closing_time': 1774885382.0, 'created_time': 1774552236.144758, 'last_price_update_time': 1774847859.301112}
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XD61678') HTTP/1.1" 204 0
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-30 05:17:39 [auto1.nl] INFO: Scrape type for YP25238: 0
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-30 05:17:39 [auto1.nl] INFO: Scrape type for HD17412: 2
2026-03-30 05:17:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with identifier: HD17412
2026-03-30 05:17:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with scrape type 2
2026-03-30 05:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with scrape type 2
2026-03-30 05:17:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a, identifier: HD17412
2026-03-30 05:17:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with identifier: HD17412
2026-03-30 05:17:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with identifier: HD17412
2026-03-30 05:17:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2a10ffc9-089c-5117-b04d-b86cdc42ce0a with identifier: HD17412 to the API
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:33:01Z',
 'fuel_type': 'diesel',
 'id': '2a10ffc9-089c-5117-b04d-b86cdc42ce0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD17412',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Multivan',
 'odometer': 390049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-10-13',
 'seller_name': None,
 'title': 'Volkswagen T4 Multivan 2.5 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-30 05:17:39 [auto1.nl] INFO: Saving data for HD17412: {'auction_closing_time': 1774884781.0, 'created_time': 1774638769.086254, 'last_price_update_time': 1774847859.703697}
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HD17412') HTTP/1.1" 204 0
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-30 05:17:39 [auto1.nl] INFO: Scrape type for ES69537: 0
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-30 05:17:39 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 758 | hits on page: 40
2026-03-30 05:17:39 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-30 05:17:39 [auto1.nl] INFO: Scrape type for CR08212: 2
2026-03-30 05:17:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d829a7de-4dce-5c27-8289-119c2fd59541 with identifier: CR08212
2026-03-30 05:17:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d829a7de-4dce-5c27-8289-119c2fd59541 with scrape type 2
2026-03-30 05:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d829a7de-4dce-5c27-8289-119c2fd59541 with scrape type 2
2026-03-30 05:17:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d829a7de-4dce-5c27-8289-119c2fd59541, identifier: CR08212
2026-03-30 05:17:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:17:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d829a7de-4dce-5c27-8289-119c2fd59541 with identifier: CR08212
2026-03-30 05:17:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d829a7de-4dce-5c27-8289-119c2fd59541 with identifier: CR08212
2026-03-30 05:17:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d829a7de-4dce-5c27-8289-119c2fd59541 with identifier: CR08212 to the API
2026-03-30 05:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:57:50Z',
 'fuel_type': 'petrol',
 'id': 'd829a7de-4dce-5c27-8289-119c2fd59541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR08212',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 106676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2017}
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-30 05:17:40 [auto1.nl] INFO: Saving data for CR08212: {'auction_closing_time': 1774886270.0, 'created_time': 1773301505.083181, 'last_price_update_time': 1774847860.114508}
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR08212') HTTP/1.1" 204 0
2026-03-30 05:17:40 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-30 05:17:40 [auto1.nl] INFO: Scrape type for GN05115: 2
2026-03-30 05:17:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with identifier: GN05115
2026-03-30 05:17:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with scrape type 2
2026-03-30 05:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with scrape type 2
2026-03-30 05:17:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4437e5ca-3ec4-5092-b5b2-caefdcc12852, identifier: GN05115
2026-03-30 05:17:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with identifier: GN05115
2026-03-30 05:17:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with identifier: GN05115
2026-03-30 05:17:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4437e5ca-3ec4-5092-b5b2-caefdcc12852 with identifier: GN05115 to the API
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:20Z',
 'fuel_type': 'petrol',
 'id': '4437e5ca-3ec4-5092-b5b2-caefdcc12852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN05115',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 85645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-30 05:17:40 [auto1.nl] INFO: Saving data for GN05115: {'auction_closing_time': 1774884620.0, 'created_time': 1774638770.873594, 'last_price_update_time': 1774847860.583309}
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN05115') HTTP/1.1" 204 0
2026-03-30 05:17:40 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-30 05:17:40 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-30 05:17:40 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-30 05:17:40 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-30 05:17:40 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-30 05:17:40 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-30 05:17:40 [auto1.nl] INFO: Scrape type for RY75066: 2
2026-03-30 05:17:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311297b7-5f2a-5400-9ef6-c2969c2cd85f with identifier: RY75066
2026-03-30 05:17:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f with scrape type 2
2026-03-30 05:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 311297b7-5f2a-5400-9ef6-c2969c2cd85f with scrape type 2
2026-03-30 05:17:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 311297b7-5f2a-5400-9ef6-c2969c2cd85f, identifier: RY75066
2026-03-30 05:17:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 311297b7-5f2a-5400-9ef6-c2969c2cd85f with identifier: RY75066
2026-03-30 05:17:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 311297b7-5f2a-5400-9ef6-c2969c2cd85f with identifier: RY75066
2026-03-30 05:17:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 311297b7-5f2a-5400-9ef6-c2969c2cd85f with identifier: RY75066 to the API
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:25:35Z',
 'fuel_type': 'diesel',
 'id': '311297b7-5f2a-5400-9ef6-c2969c2cd85f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY75066',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 105326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'Peugeot Expert 1.6 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2018}
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-30 05:17:40 [auto1.nl] INFO: Saving data for RY75066: {'auction_closing_time': 1774884335.0, 'created_time': 1774638736.800266, 'last_price_update_time': 1774847860.991964}
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY75066') HTTP/1.1" 204 0
2026-03-30 05:17:41 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-30 05:17:41 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-30 05:17:41 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-30 05:17:41 [auto1.nl] INFO: Scrape type for CJ41969: 0
2026-03-30 05:17:41 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-30 05:17:41 [auto1.nl] INFO: Scrape type for BD37870: 2
2026-03-30 05:17:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with identifier: BD37870
2026-03-30 05:17:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with scrape type 2
2026-03-30 05:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with scrape type 2
2026-03-30 05:17:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7, identifier: BD37870
2026-03-30 05:17:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with identifier: BD37870
2026-03-30 05:17:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with identifier: BD37870
2026-03-30 05:17:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83458b5c-b0f8-5c88-85f2-01291ea4ccb7 with identifier: BD37870 to the API
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:10:24Z',
 'fuel_type': 'petrol',
 'id': '83458b5c-b0f8-5c88-85f2-01291ea4ccb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD37870',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 176745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-10-26',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.3 Comfort 1300',
 'transmission': 'manual',
 'trim': 'Comfort 1300',
 'year': 2001}
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-30 05:17:41 [auto1.nl] INFO: Saving data for BD37870: {'auction_closing_time': 1774883424.0, 'created_time': 1774552271.300788, 'last_price_update_time': 1774847861.377052}
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD37870') HTTP/1.1" 204 0
2026-03-30 05:17:41 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-30 05:17:41 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-30 05:17:41 [auto1.nl] INFO: Scrape type for WK29789: 0
2026-03-30 05:17:41 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-30 05:17:41 [auto1.nl] INFO: Scrape type for KV87922: 2
2026-03-30 05:17:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 785fd0aa-717b-556e-8ca0-7e1ca1377923 with identifier: KV87922
2026-03-30 05:17:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 785fd0aa-717b-556e-8ca0-7e1ca1377923 with scrape type 2
2026-03-30 05:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 785fd0aa-717b-556e-8ca0-7e1ca1377923 with scrape type 2
2026-03-30 05:17:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 785fd0aa-717b-556e-8ca0-7e1ca1377923, identifier: KV87922
2026-03-30 05:17:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 785fd0aa-717b-556e-8ca0-7e1ca1377923 with identifier: KV87922
2026-03-30 05:17:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 785fd0aa-717b-556e-8ca0-7e1ca1377923 with identifier: KV87922
2026-03-30 05:17:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 785fd0aa-717b-556e-8ca0-7e1ca1377923 with identifier: KV87922 to the API
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:46:30Z',
 'fuel_type': 'diesel',
 'id': '785fd0aa-717b-556e-8ca0-7e1ca1377923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV87922',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 144845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-22',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-30 05:17:41 [auto1.nl] INFO: Saving data for KV87922: {'auction_closing_time': 1774885590.0, 'created_time': 1773343127.74614, 'last_price_update_time': 1774847861.771695}
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV87922') HTTP/1.1" 204 0
2026-03-30 05:17:41 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-30 05:17:41 [auto1.nl] INFO: Scrape type for EL29526: 2
2026-03-30 05:17:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with identifier: EL29526
2026-03-30 05:17:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with scrape type 2
2026-03-30 05:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with scrape type 2
2026-03-30 05:17:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0, identifier: EL29526
2026-03-30 05:17:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with identifier: EL29526
2026-03-30 05:17:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with identifier: EL29526
2026-03-30 05:17:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0 with identifier: EL29526 to the API
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:54:11Z',
 'fuel_type': 'petrol',
 'id': '7968fc7e-f4ad-5a98-a6eb-cc02cbb44bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL29526',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 278899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-17',
 'seller_name': None,
 'title': 'Volvo V50 1.8 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2009}
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-30 05:17:42 [auto1.nl] INFO: Saving data for EL29526: {'auction_closing_time': 1774886051.0, 'created_time': 1774638737.492752, 'last_price_update_time': 1774847862.233349}
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EL29526') HTTP/1.1" 204 0
2026-03-30 05:17:42 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-30 05:17:42 [auto1.nl] INFO: Scrape type for CP17463: 0
2026-03-30 05:17:42 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-30 05:17:42 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-30 05:17:42 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-30 05:17:42 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-30 05:17:42 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-30 05:17:42 [auto1.nl] INFO: Scrape type for SM80467: 0
2026-03-30 05:17:42 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-30 05:17:42 [auto1.nl] INFO: Scrape type for EH64896: 2
2026-03-30 05:17:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5f43aae-7eba-5d68-b4f0-69e3e6246574 with identifier: EH64896
2026-03-30 05:17:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5f43aae-7eba-5d68-b4f0-69e3e6246574 with scrape type 2
2026-03-30 05:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5f43aae-7eba-5d68-b4f0-69e3e6246574 with scrape type 2
2026-03-30 05:17:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5f43aae-7eba-5d68-b4f0-69e3e6246574, identifier: EH64896
2026-03-30 05:17:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5f43aae-7eba-5d68-b4f0-69e3e6246574 with identifier: EH64896
2026-03-30 05:17:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5f43aae-7eba-5d68-b4f0-69e3e6246574 with identifier: EH64896
2026-03-30 05:17:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5f43aae-7eba-5d68-b4f0-69e3e6246574 with identifier: EH64896 to the API
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:02:49Z',
 'fuel_type': 'hybrid',
 'id': 'e5f43aae-7eba-5d68-b4f0-69e3e6246574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH64896',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 41525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Toyota C-HR 2.0 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2019}
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-30 05:17:42 [auto1.nl] INFO: Saving data for EH64896: {'auction_closing_time': 1774882969.0, 'created_time': 1774638729.017565, 'last_price_update_time': 1774847862.707275}
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH64896') HTTP/1.1" 204 0
2026-03-30 05:17:42 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-30 05:17:42 [auto1.nl] INFO: Scrape type for DB11708: 2
2026-03-30 05:17:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5b5f078-b143-53f1-b3db-e9c7206952ad with identifier: DB11708
2026-03-30 05:17:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b5f078-b143-53f1-b3db-e9c7206952ad with scrape type 2
2026-03-30 05:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5b5f078-b143-53f1-b3db-e9c7206952ad with scrape type 2
2026-03-30 05:17:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c5b5f078-b143-53f1-b3db-e9c7206952ad, identifier: DB11708
2026-03-30 05:17:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c5b5f078-b143-53f1-b3db-e9c7206952ad with identifier: DB11708
2026-03-30 05:17:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c5b5f078-b143-53f1-b3db-e9c7206952ad with identifier: DB11708
2026-03-30 05:17:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c5b5f078-b143-53f1-b3db-e9c7206952ad with identifier: DB11708 to the API
2026-03-30 05:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:30:38Z',
 'fuel_type': 'diesel',
 'id': 'c5b5f078-b143-53f1-b3db-e9c7206952ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB11708',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 248911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2012}
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-30 05:17:43 [auto1.nl] INFO: Saving data for DB11708: {'auction_closing_time': 1774884638.0, 'created_time': 1774638746.317512, 'last_price_update_time': 1774847863.124598}
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DB11708') HTTP/1.1" 204 0
2026-03-30 05:17:43 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-30 05:17:43 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-30 05:17:43 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX51139%27 HTTP/1.1" 200 None
2026-03-30 05:17:43 [auto1.nl] INFO: Scrape type for PX51139: 0
2026-03-30 05:17:43 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-30 05:17:43 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-30 05:17:43 [auto1.nl] INFO: Scrape type for AZ42388: 2
2026-03-30 05:17:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19447c5-2ff9-5c76-a231-e99044922abe with identifier: AZ42388
2026-03-30 05:17:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19447c5-2ff9-5c76-a231-e99044922abe with scrape type 2
2026-03-30 05:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19447c5-2ff9-5c76-a231-e99044922abe with scrape type 2
2026-03-30 05:17:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b19447c5-2ff9-5c76-a231-e99044922abe, identifier: AZ42388
2026-03-30 05:17:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b19447c5-2ff9-5c76-a231-e99044922abe with identifier: AZ42388
2026-03-30 05:17:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b19447c5-2ff9-5c76-a231-e99044922abe with identifier: AZ42388
2026-03-30 05:17:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b19447c5-2ff9-5c76-a231-e99044922abe with identifier: AZ42388 to the API
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:17Z',
 'fuel_type': 'petrol',
 'id': 'b19447c5-2ff9-5c76-a231-e99044922abe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ42388',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 52485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-12',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-30 05:17:43 [auto1.nl] INFO: Saving data for AZ42388: {'auction_closing_time': 1774883177.0, 'created_time': 1773925672.010005, 'last_price_update_time': 1774847863.521221}
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AZ42388') HTTP/1.1" 204 0
2026-03-30 05:17:43 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-30 05:17:43 [auto1.nl] INFO: Scrape type for DU88284: 2
2026-03-30 05:17:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4349fa8f-f460-5934-a538-5d108c7270ba with identifier: DU88284
2026-03-30 05:17:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4349fa8f-f460-5934-a538-5d108c7270ba with scrape type 2
2026-03-30 05:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4349fa8f-f460-5934-a538-5d108c7270ba with scrape type 2
2026-03-30 05:17:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4349fa8f-f460-5934-a538-5d108c7270ba, identifier: DU88284
2026-03-30 05:17:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4349fa8f-f460-5934-a538-5d108c7270ba with identifier: DU88284
2026-03-30 05:17:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4349fa8f-f460-5934-a538-5d108c7270ba with identifier: DU88284
2026-03-30 05:17:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4349fa8f-f460-5934-a538-5d108c7270ba with identifier: DU88284 to the API
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:52:05Z',
 'fuel_type': 'petrol',
 'id': '4349fa8f-f460-5934-a538-5d108c7270ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU88284',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 65806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-30 05:17:43 [auto1.nl] INFO: Saving data for DU88284: {'auction_closing_time': 1774885925.0, 'created_time': 1774552333.362678, 'last_price_update_time': 1774847863.98187}
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU88284') HTTP/1.1" 204 0
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-30 05:17:44 [auto1.nl] INFO: Scrape type for TW55830: 2
2026-03-30 05:17:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with identifier: TW55830
2026-03-30 05:17:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with scrape type 2
2026-03-30 05:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with scrape type 2
2026-03-30 05:17:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7aee8ae9-e884-51bf-9f01-16d61bd3c949, identifier: TW55830
2026-03-30 05:17:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with identifier: TW55830
2026-03-30 05:17:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with identifier: TW55830
2026-03-30 05:17:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7aee8ae9-e884-51bf-9f01-16d61bd3c949 with identifier: TW55830 to the API
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:09:04Z',
 'fuel_type': 'petrol',
 'id': '7aee8ae9-e884-51bf-9f01-16d61bd3c949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW55830',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 349963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-05-05',
 'seller_name': None,
 'title': 'Audi TT 1.8 Turbo Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 1999}
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-30 05:17:44 [auto1.nl] INFO: Saving data for TW55830: {'auction_closing_time': 1774883344.0, 'created_time': 1774638726.996706, 'last_price_update_time': 1774847864.379855}
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TW55830') HTTP/1.1" 204 0
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-30 05:17:44 [auto1.nl] INFO: Scrape type for PA43644: 0
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-30 05:17:44 [auto1.nl] INFO: Scrape type for BU16200: 0
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-30 05:17:44 [auto1.nl] INFO: Scrape type for HC58225: 2
2026-03-30 05:17:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc62df0-ef04-543d-8023-d8c9492ee56d with identifier: HC58225
2026-03-30 05:17:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc62df0-ef04-543d-8023-d8c9492ee56d with scrape type 2
2026-03-30 05:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cc62df0-ef04-543d-8023-d8c9492ee56d with scrape type 2
2026-03-30 05:17:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1cc62df0-ef04-543d-8023-d8c9492ee56d, identifier: HC58225
2026-03-30 05:17:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1cc62df0-ef04-543d-8023-d8c9492ee56d with identifier: HC58225
2026-03-30 05:17:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1cc62df0-ef04-543d-8023-d8c9492ee56d with identifier: HC58225
2026-03-30 05:17:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1cc62df0-ef04-543d-8023-d8c9492ee56d with identifier: HC58225 to the API
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:26Z',
 'fuel_type': 'diesel',
 'id': '1cc62df0-ef04-543d-8023-d8c9492ee56d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC58225',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 334609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2014}
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-30 05:17:44 [auto1.nl] INFO: Saving data for HC58225: {'auction_closing_time': 1774885286.0, 'created_time': 1774638773.604405, 'last_price_update_time': 1774847864.779032}
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HC58225') HTTP/1.1" 204 0
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-30 05:17:44 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-30 05:17:44 [auto1.nl] INFO: Scrape type for SY53039: 0
2026-03-30 05:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:17:51 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 758 | hits on page: 40
2026-03-30 05:17:51 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-30 05:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-30 05:17:51 [auto1.nl] INFO: Scrape type for DN96174: 0
2026-03-30 05:17:51 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-30 05:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-30 05:17:51 [auto1.nl] INFO: Scrape type for BD28084: 2
2026-03-30 05:17:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 037ab206-67d4-52ce-9ffe-d7bf1d66198a with identifier: BD28084
2026-03-30 05:17:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037ab206-67d4-52ce-9ffe-d7bf1d66198a with scrape type 2
2026-03-30 05:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 037ab206-67d4-52ce-9ffe-d7bf1d66198a with scrape type 2
2026-03-30 05:17:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 037ab206-67d4-52ce-9ffe-d7bf1d66198a, identifier: BD28084
2026-03-30 05:17:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 037ab206-67d4-52ce-9ffe-d7bf1d66198a with identifier: BD28084
2026-03-30 05:17:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 037ab206-67d4-52ce-9ffe-d7bf1d66198a with identifier: BD28084
2026-03-30 05:17:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 037ab206-67d4-52ce-9ffe-d7bf1d66198a with identifier: BD28084 to the API
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:40:12Z',
 'fuel_type': 'petrol',
 'id': '037ab206-67d4-52ce-9ffe-d7bf1d66198a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD28084',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 148076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-23',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2015}
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Saving data for BD28084: {'auction_closing_time': 1774885212.0, 'created_time': 1774552322.040828, 'last_price_update_time': 1774847872.322374}
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD28084') HTTP/1.1" 204 0
2026-03-30 05:17:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Scrape type for SE84312: 0
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Scrape type for DZ87358: 0
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Scrape type for LE78061: 0
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Scrape type for RC74228: 0
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Scrape type for MD57319: 0
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Scrape type for JG11787: 2
2026-03-30 05:17:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a48a363-e345-5c36-8c80-6b79d093f906 with identifier: JG11787
2026-03-30 05:17:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a48a363-e345-5c36-8c80-6b79d093f906 with scrape type 2
2026-03-30 05:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a48a363-e345-5c36-8c80-6b79d093f906 with scrape type 2
2026-03-30 05:17:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7a48a363-e345-5c36-8c80-6b79d093f906, identifier: JG11787
2026-03-30 05:17:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7a48a363-e345-5c36-8c80-6b79d093f906 with identifier: JG11787
2026-03-30 05:17:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7a48a363-e345-5c36-8c80-6b79d093f906 with identifier: JG11787
2026-03-30 05:17:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7a48a363-e345-5c36-8c80-6b79d093f906 with identifier: JG11787 to the API
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:19:46Z',
 'fuel_type': 'diesel',
 'id': '7a48a363-e345-5c36-8c80-6b79d093f906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG11787',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 125645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Active Business",
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2021}
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Saving data for JG11787: {'auction_closing_time': 1774883986.0, 'created_time': 1774552223.848903, 'last_price_update_time': 1774847872.935784}
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG11787') HTTP/1.1" 204 0
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Scrape type for NT33284: 0
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-30 05:17:52 [auto1.nl] INFO: Scrape type for FR68688: 0
2026-03-30 05:17:52 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-30 05:17:53 [auto1.nl] INFO: Scrape type for WF02577: 0
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-30 05:17:53 [auto1.nl] INFO: Scrape type for AE06801: 0
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-30 05:17:53 [auto1.nl] INFO: Scrape type for CH10226: 2
2026-03-30 05:17:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19aaf720-730f-5f6f-a418-0f20033e49fe with identifier: CH10226
2026-03-30 05:17:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19aaf720-730f-5f6f-a418-0f20033e49fe with scrape type 2
2026-03-30 05:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19aaf720-730f-5f6f-a418-0f20033e49fe with scrape type 2
2026-03-30 05:17:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 19aaf720-730f-5f6f-a418-0f20033e49fe, identifier: CH10226
2026-03-30 05:17:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 19aaf720-730f-5f6f-a418-0f20033e49fe with identifier: CH10226
2026-03-30 05:17:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 19aaf720-730f-5f6f-a418-0f20033e49fe with identifier: CH10226
2026-03-30 05:17:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 19aaf720-730f-5f6f-a418-0f20033e49fe with identifier: CH10226 to the API
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:13:53Z',
 'fuel_type': 'petrol',
 'id': '19aaf720-730f-5f6f-a418-0f20033e49fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH10226',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 188328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-30 05:17:53 [auto1.nl] INFO: Saving data for CH10226: {'auction_closing_time': 1774883633.0, 'created_time': 1774552320.682249, 'last_price_update_time': 1774847873.415006}
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CH10226') HTTP/1.1" 204 0
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-30 05:17:53 [auto1.nl] INFO: Scrape type for BM26306: 0
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE94931%27 HTTP/1.1" 200 None
2026-03-30 05:17:53 [auto1.nl] INFO: Scrape type for NE94931: 2
2026-03-30 05:17:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d635a65-af3c-56a4-a99f-745dbf8e0edf with identifier: NE94931
2026-03-30 05:17:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf with scrape type 2
2026-03-30 05:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d635a65-af3c-56a4-a99f-745dbf8e0edf with scrape type 2
2026-03-30 05:17:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d635a65-af3c-56a4-a99f-745dbf8e0edf, identifier: NE94931
2026-03-30 05:17:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d635a65-af3c-56a4-a99f-745dbf8e0edf with identifier: NE94931
2026-03-30 05:17:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d635a65-af3c-56a4-a99f-745dbf8e0edf with identifier: NE94931
2026-03-30 05:17:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d635a65-af3c-56a4-a99f-745dbf8e0edf with identifier: NE94931 to the API
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:11:06Z',
 'fuel_type': 'diesel',
 'id': '3d635a65-af3c-56a4-a99f-745dbf8e0edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE94931',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 286793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-03',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Ocean Race',
 'transmission': 'manual',
 'trim': 'Ocean Race',
 'year': 2015}
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE94931%27 HTTP/1.1" 200 None
2026-03-30 05:17:53 [auto1.nl] INFO: Saving data for NE94931: {'auction_closing_time': 1774883466.0, 'created_time': 1774725059.157855, 'last_price_update_time': 1774847873.902036}
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NE94931') HTTP/1.1" 204 0
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-30 05:17:53 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-30 05:17:53 [auto1.nl] INFO: Scrape type for JS13271: 2
2026-03-30 05:17:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with identifier: JS13271
2026-03-30 05:17:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with scrape type 2
2026-03-30 05:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with scrape type 2
2026-03-30 05:17:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5, identifier: JS13271
2026-03-30 05:17:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with identifier: JS13271
2026-03-30 05:17:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with identifier: JS13271
2026-03-30 05:17:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0bfd9b93-5cba-523d-ac0d-9ba97d580fe5 with identifier: JS13271 to the API
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:29:01Z',
 'fuel_type': 'petrol',
 'id': '0bfd9b93-5cba-523d-ac0d-9ba97d580fe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS13271',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 100765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-30 05:17:54 [auto1.nl] INFO: Saving data for JS13271: {'auction_closing_time': 1774884541.0, 'created_time': 1774552350.407712, 'last_price_update_time': 1774847874.28769}
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JS13271') HTTP/1.1" 204 0
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-30 05:17:54 [auto1.nl] INFO: Scrape type for WG27101: 0
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-30 05:17:54 [auto1.nl] INFO: Scrape type for UB80121: 0
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-30 05:17:54 [auto1.nl] INFO: Scrape type for YE50957: 0
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-30 05:17:54 [auto1.nl] INFO: Scrape type for YH72796: 0
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-30 05:17:54 [auto1.nl] INFO: Scrape type for GG02103: 0
2026-03-30 05:17:54 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-30 05:17:54 [auto1.nl] INFO: Scrape type for NB25760: 2
2026-03-30 05:17:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8983b51f-d266-597e-bb8a-b736d0e6f2ea with identifier: NB25760
2026-03-30 05:17:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8983b51f-d266-597e-bb8a-b736d0e6f2ea with scrape type 2
2026-03-30 05:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8983b51f-d266-597e-bb8a-b736d0e6f2ea with scrape type 2
2026-03-30 05:17:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8983b51f-d266-597e-bb8a-b736d0e6f2ea, identifier: NB25760
2026-03-30 05:17:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8983b51f-d266-597e-bb8a-b736d0e6f2ea with identifier: NB25760
2026-03-30 05:17:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8983b51f-d266-597e-bb8a-b736d0e6f2ea with identifier: NB25760
2026-03-30 05:17:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8983b51f-d266-597e-bb8a-b736d0e6f2ea with identifier: NB25760 to the API
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:17:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:07:18Z',
 'fuel_type': 'petrol',
 'id': '8983b51f-d266-597e-bb8a-b736d0e6f2ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB25760',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 285689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-12',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2008}
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-30 05:17:54 [auto1.nl] INFO: Saving data for NB25760: {'auction_closing_time': 1774883238.0, 'created_time': 1774552334.796662, 'last_price_update_time': 1774847874.757513}
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NB25760') HTTP/1.1" 204 0
2026-03-30 05:18:06 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 5 pages/min), scraped 73 items (at 49 items/min)
2026-03-30 05:18:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-30 05:19:06 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 0 pages/min), scraped 73 items (at 0 items/min)
2026-03-30 05:19:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-30 05:20:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.139(s), this was the 1st time calling it.
2026-03-30 05:20:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6481354136384967 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 05:20:06 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 0 pages/min), scraped 73 items (at 0 items/min)
2026-03-30 05:20:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-30 05:20:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 05:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:20:40 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 758 | hits on page: 40
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-30 05:20:40 [auto1.nl] INFO: Scrape type for GY41852: 2
2026-03-30 05:20:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f8592ce-bc10-53f6-9c07-795ec47b0001 with identifier: GY41852
2026-03-30 05:20:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8592ce-bc10-53f6-9c07-795ec47b0001 with scrape type 2
2026-03-30 05:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f8592ce-bc10-53f6-9c07-795ec47b0001 with scrape type 2
2026-03-30 05:20:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7f8592ce-bc10-53f6-9c07-795ec47b0001, identifier: GY41852
2026-03-30 05:20:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7f8592ce-bc10-53f6-9c07-795ec47b0001 with identifier: GY41852
2026-03-30 05:20:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7f8592ce-bc10-53f6-9c07-795ec47b0001 with identifier: GY41852
2026-03-30 05:20:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7f8592ce-bc10-53f6-9c07-795ec47b0001 with identifier: GY41852 to the API
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:22:51Z',
 'fuel_type': 'hybrid',
 'id': '7f8592ce-bc10-53f6-9c07-795ec47b0001',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY41852',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 100137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-31',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-30 05:20:40 [auto1.nl] INFO: Saving data for GY41852: {'auction_closing_time': 1774884171.0, 'created_time': 1774552315.514399, 'last_price_update_time': 1774848040.509188}
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY41852') HTTP/1.1" 204 0
2026-03-30 05:20:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-30 05:20:40 [auto1.nl] INFO: Scrape type for EG83115: 2
2026-03-30 05:20:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2906658-b1da-5fae-b8b1-64deb3da18eb with identifier: EG83115
2026-03-30 05:20:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2906658-b1da-5fae-b8b1-64deb3da18eb with scrape type 2
2026-03-30 05:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2906658-b1da-5fae-b8b1-64deb3da18eb with scrape type 2
2026-03-30 05:20:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2906658-b1da-5fae-b8b1-64deb3da18eb, identifier: EG83115
2026-03-30 05:20:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2906658-b1da-5fae-b8b1-64deb3da18eb with identifier: EG83115
2026-03-30 05:20:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2906658-b1da-5fae-b8b1-64deb3da18eb with identifier: EG83115
2026-03-30 05:20:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2906658-b1da-5fae-b8b1-64deb3da18eb with identifier: EG83115 to the API
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:27:49Z',
 'fuel_type': 'petrol',
 'id': 'f2906658-b1da-5fae-b8b1-64deb3da18eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG83115',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 285390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'automatic',
 'trim': 'Turismo',
 'year': 2013}
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-30 05:20:40 [auto1.nl] INFO: Saving data for EG83115: {'auction_closing_time': 1774884469.0, 'created_time': 1774552308.456859, 'last_price_update_time': 1774848040.907386}
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG83115') HTTP/1.1" 204 0
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-30 05:20:40 [auto1.nl] INFO: Scrape type for UC91516: 0
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-30 05:20:40 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-30 05:20:40 [auto1.nl] INFO: Scrape type for EM54492: 2
2026-03-30 05:20:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with identifier: EM54492
2026-03-30 05:20:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with scrape type 2
2026-03-30 05:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with scrape type 2
2026-03-30 05:20:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444, identifier: EM54492
2026-03-30 05:20:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with identifier: EM54492
2026-03-30 05:20:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with identifier: EM54492
2026-03-30 05:20:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 60be9cbe-b38b-5fd8-b3ee-b90f1ea78444 with identifier: EM54492 to the API
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:28:42Z',
 'fuel_type': 'diesel',
 'id': '60be9cbe-b38b-5fd8-b3ee-b90f1ea78444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM54492',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 192254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-28',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2008}
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-30 05:20:41 [auto1.nl] INFO: Saving data for EM54492: {'auction_closing_time': 1774884522.0, 'created_time': 1774552222.096869, 'last_price_update_time': 1774848041.331606}
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM54492') HTTP/1.1" 204 0
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ09106%27 HTTP/1.1" 200 None
2026-03-30 05:20:41 [auto1.nl] INFO: Scrape type for YZ09106: 0
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-30 05:20:41 [auto1.nl] INFO: Scrape type for GN89359: 2
2026-03-30 05:20:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da8523f-5424-53e9-9206-8cba63f46b4f with identifier: GN89359
2026-03-30 05:20:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da8523f-5424-53e9-9206-8cba63f46b4f with scrape type 2
2026-03-30 05:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da8523f-5424-53e9-9206-8cba63f46b4f with scrape type 2
2026-03-30 05:20:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4da8523f-5424-53e9-9206-8cba63f46b4f, identifier: GN89359
2026-03-30 05:20:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4da8523f-5424-53e9-9206-8cba63f46b4f with identifier: GN89359
2026-03-30 05:20:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4da8523f-5424-53e9-9206-8cba63f46b4f with identifier: GN89359
2026-03-30 05:20:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4da8523f-5424-53e9-9206-8cba63f46b4f with identifier: GN89359 to the API
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:47:02Z',
 'fuel_type': 'petrol',
 'id': '4da8523f-5424-53e9-9206-8cba63f46b4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN89359',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 177662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-06',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-30 05:20:41 [auto1.nl] INFO: Saving data for GN89359: {'auction_closing_time': 1774885622.0, 'created_time': 1774638735.061754, 'last_price_update_time': 1774848041.842703}
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN89359') HTTP/1.1" 204 0
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-30 05:20:41 [auto1.nl] INFO: Scrape type for NS14796: 0
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-30 05:20:41 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-30 05:20:41 [auto1.nl] INFO: Scrape type for AZ90827: 2
2026-03-30 05:20:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09bb1312-3a4a-5a45-a830-efd44ed88bba with identifier: AZ90827
2026-03-30 05:20:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09bb1312-3a4a-5a45-a830-efd44ed88bba with scrape type 2
2026-03-30 05:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09bb1312-3a4a-5a45-a830-efd44ed88bba with scrape type 2
2026-03-30 05:20:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 09bb1312-3a4a-5a45-a830-efd44ed88bba, identifier: AZ90827
2026-03-30 05:20:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 09bb1312-3a4a-5a45-a830-efd44ed88bba with identifier: AZ90827
2026-03-30 05:20:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 09bb1312-3a4a-5a45-a830-efd44ed88bba with identifier: AZ90827
2026-03-30 05:20:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 09bb1312-3a4a-5a45-a830-efd44ed88bba with identifier: AZ90827 to the API
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:59:48Z',
 'fuel_type': 'petrol',
 'id': '09bb1312-3a4a-5a45-a830-efd44ed88bba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ90827',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 73604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-21',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2004}
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Saving data for AZ90827: {'auction_closing_time': 1774886388.0, 'created_time': 1774552224.221834, 'last_price_update_time': 1774848042.265666}
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AZ90827') HTTP/1.1" 204 0
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Scrape type for VH01672: 0
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Scrape type for JX11008: 0
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Scrape type for MW03156: 0
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Scrape type for VR09113: 0
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ58386%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Scrape type for HJ58386: 0
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Scrape type for KD36085: 2
2026-03-30 05:20:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with identifier: KD36085
2026-03-30 05:20:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with scrape type 2
2026-03-30 05:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with scrape type 2
2026-03-30 05:20:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829, identifier: KD36085
2026-03-30 05:20:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with identifier: KD36085
2026-03-30 05:20:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with identifier: KD36085
2026-03-30 05:20:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b59c4f7-2ae1-5bbc-96fa-f372c4e86829 with identifier: KD36085 to the API
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:54:16Z',
 'fuel_type': 'petrol',
 'id': '8b59c4f7-2ae1-5bbc-96fa-f372c4e86829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD36085',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 76273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-19',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 THP Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Saving data for KD36085: {'auction_closing_time': 1774886056.0, 'created_time': 1774638772.365037, 'last_price_update_time': 1774848042.751732}
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KD36085') HTTP/1.1" 204 0
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-30 05:20:42 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-30 05:20:42 [auto1.nl] INFO: Scrape type for GB93242: 2
2026-03-30 05:20:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4023467b-c0c8-5c07-a86f-2d364e5924f9 with identifier: GB93242
2026-03-30 05:20:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4023467b-c0c8-5c07-a86f-2d364e5924f9 with scrape type 2
2026-03-30 05:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4023467b-c0c8-5c07-a86f-2d364e5924f9 with scrape type 2
2026-03-30 05:20:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4023467b-c0c8-5c07-a86f-2d364e5924f9, identifier: GB93242
2026-03-30 05:20:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4023467b-c0c8-5c07-a86f-2d364e5924f9 with identifier: GB93242
2026-03-30 05:20:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4023467b-c0c8-5c07-a86f-2d364e5924f9 with identifier: GB93242
2026-03-30 05:20:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4023467b-c0c8-5c07-a86f-2d364e5924f9 with identifier: GB93242 to the API
2026-03-30 05:20:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:16:18Z',
 'fuel_type': 'hybrid',
 'id': '4023467b-c0c8-5c07-a86f-2d364e5924f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB93242',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-30 05:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-30 05:20:43 [auto1.nl] INFO: Saving data for GB93242: {'auction_closing_time': 1774883778.0, 'created_time': 1774552221.224892, 'last_price_update_time': 1774848043.24553}
2026-03-30 05:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GB93242') HTTP/1.1" 204 0
2026-03-30 05:20:43 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-30 05:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-30 05:20:43 [auto1.nl] INFO: Scrape type for YN37403: 0
2026-03-30 05:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:20:44 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 758 | hits on page: 40
2026-03-30 05:20:44 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-30 05:20:44 [auto1.nl] INFO: Scrape type for FE21861: 0
2026-03-30 05:20:44 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-30 05:20:44 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-30 05:20:44 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-30 05:20:44 [auto1.nl] INFO: Scrape type for FK39304: 0
2026-03-30 05:20:44 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-30 05:20:44 [auto1.nl] INFO: Scrape type for LU83430: 2
2026-03-30 05:20:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a95461-e388-5b7c-8d87-86cf6d16c6ef with identifier: LU83430
2026-03-30 05:20:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3a95461-e388-5b7c-8d87-86cf6d16c6ef with scrape type 2
2026-03-30 05:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3a95461-e388-5b7c-8d87-86cf6d16c6ef with scrape type 2
2026-03-30 05:20:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f3a95461-e388-5b7c-8d87-86cf6d16c6ef, identifier: LU83430
2026-03-30 05:20:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f3a95461-e388-5b7c-8d87-86cf6d16c6ef with identifier: LU83430
2026-03-30 05:20:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f3a95461-e388-5b7c-8d87-86cf6d16c6ef with identifier: LU83430
2026-03-30 05:20:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f3a95461-e388-5b7c-8d87-86cf6d16c6ef with identifier: LU83430 to the API
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:28:48Z',
 'fuel_type': 'hybrid',
 'id': 'f3a95461-e388-5b7c-8d87-86cf6d16c6ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU83430',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 264554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-30',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D5 Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2015}
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-30 05:20:44 [auto1.nl] INFO: Saving data for LU83430: {'auction_closing_time': 1774884528.0, 'created_time': 1774552302.610548, 'last_price_update_time': 1774848044.602545}
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LU83430') HTTP/1.1" 204 0
2026-03-30 05:20:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:20:44 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-30 05:20:44 [auto1.nl] INFO: Scrape type for PY93062: 2
2026-03-30 05:20:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00abfc61-a1f5-51d6-9777-9c514a26915e with identifier: PY93062
2026-03-30 05:20:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00abfc61-a1f5-51d6-9777-9c514a26915e with scrape type 2
2026-03-30 05:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00abfc61-a1f5-51d6-9777-9c514a26915e with scrape type 2
2026-03-30 05:20:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00abfc61-a1f5-51d6-9777-9c514a26915e, identifier: PY93062
2026-03-30 05:20:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00abfc61-a1f5-51d6-9777-9c514a26915e with identifier: PY93062
2026-03-30 05:20:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00abfc61-a1f5-51d6-9777-9c514a26915e with identifier: PY93062
2026-03-30 05:20:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00abfc61-a1f5-51d6-9777-9c514a26915e with identifier: PY93062 to the API
2026-03-30 05:20:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:11:46Z',
 'fuel_type': 'petrol',
 'id': '00abfc61-a1f5-51d6-9777-9c514a26915e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY93062',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Eos',
 'odometer': 187052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-17',
 'seller_name': None,
 'title': 'Volkswagen Eos 2.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-30 05:20:45 [auto1.nl] INFO: Saving data for PY93062: {'auction_closing_time': 1774883506.0, 'created_time': 1774638735.379998, 'last_price_update_time': 1774848045.376734}
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY93062') HTTP/1.1" 204 0
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-30 05:20:45 [auto1.nl] INFO: Scrape type for PY55457: 0
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-30 05:20:45 [auto1.nl] INFO: Scrape type for CL54405: 0
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-30 05:20:45 [auto1.nl] INFO: Scrape type for AJ38016: 2
2026-03-30 05:20:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with identifier: AJ38016
2026-03-30 05:20:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with scrape type 2
2026-03-30 05:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with scrape type 2
2026-03-30 05:20:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f, identifier: AJ38016
2026-03-30 05:20:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with identifier: AJ38016
2026-03-30 05:20:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with identifier: AJ38016
2026-03-30 05:20:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f with identifier: AJ38016 to the API
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:15:56Z',
 'fuel_type': 'petrol',
 'id': 'd68df2ee-dccb-5ab0-8ec6-69d8bb9a0e1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ38016',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 290927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-12',
 'seller_name': None,
 'title': 'Volvo XC90 2.9 T6 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2004}
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-30 05:20:45 [auto1.nl] INFO: Saving data for AJ38016: {'auction_closing_time': 1774883756.0, 'created_time': 1774440705.356623, 'last_price_update_time': 1774848045.825845}
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AJ38016') HTTP/1.1" 204 0
2026-03-30 05:20:45 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-30 05:20:45 [auto1.nl] INFO: Scrape type for HW48392: 2
2026-03-30 05:20:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b034c21d-dcfd-5dcb-b9ea-4be310699681 with identifier: HW48392
2026-03-30 05:20:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b034c21d-dcfd-5dcb-b9ea-4be310699681 with scrape type 2
2026-03-30 05:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b034c21d-dcfd-5dcb-b9ea-4be310699681 with scrape type 2
2026-03-30 05:20:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b034c21d-dcfd-5dcb-b9ea-4be310699681, identifier: HW48392
2026-03-30 05:20:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b034c21d-dcfd-5dcb-b9ea-4be310699681 with identifier: HW48392
2026-03-30 05:20:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b034c21d-dcfd-5dcb-b9ea-4be310699681 with identifier: HW48392
2026-03-30 05:20:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b034c21d-dcfd-5dcb-b9ea-4be310699681 with identifier: HW48392 to the API
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:13:28Z',
 'fuel_type': 'petrol',
 'id': 'b034c21d-dcfd-5dcb-b9ea-4be310699681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW48392',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-02',
 'seller_name': None,
 'title': 'BMW 5er 530i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Saving data for HW48392: {'auction_closing_time': 1774883608.0, 'created_time': 1774552304.630107, 'last_price_update_time': 1774848046.298252}
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW48392') HTTP/1.1" 204 0
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Scrape type for RJ32742: 2
2026-03-30 05:20:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with identifier: RJ32742
2026-03-30 05:20:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with scrape type 2
2026-03-30 05:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with scrape type 2
2026-03-30 05:20:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4, identifier: RJ32742
2026-03-30 05:20:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with identifier: RJ32742
2026-03-30 05:20:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with identifier: RJ32742
2026-03-30 05:20:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 283c78cb-1235-5e9a-ad6e-38c256a3b7d4 with identifier: RJ32742 to the API
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:25:23Z',
 'fuel_type': 'diesel',
 'id': '283c78cb-1235-5e9a-ad6e-38c256a3b7d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ32742',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 California',
 'odometer': 437114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-08-03',
 'seller_name': None,
 'title': 'Volkswagen T4 California 2.4 Diesel Aufstelldach',
 'transmission': 'manual',
 'trim': 'Aufstelldach',
 'year': 1992}
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Saving data for RJ32742: {'auction_closing_time': 1774884323.0, 'created_time': 1774552353.813621, 'last_price_update_time': 1774848046.683634}
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RJ32742') HTTP/1.1" 204 0
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Scrape type for MD45251: 0
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Scrape type for EJ39658: 0
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Scrape type for ME20407: 0
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Scrape type for LG71332: 0
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF49809%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Scrape type for KF49809: 0
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-30 05:20:46 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-30 05:20:46 [auto1.nl] INFO: Scrape type for AM07460: 2
2026-03-30 05:20:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a26724a-46c7-5622-a89f-1089014ba93b with identifier: AM07460
2026-03-30 05:20:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a26724a-46c7-5622-a89f-1089014ba93b with scrape type 2
2026-03-30 05:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a26724a-46c7-5622-a89f-1089014ba93b with scrape type 2
2026-03-30 05:20:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a26724a-46c7-5622-a89f-1089014ba93b, identifier: AM07460
2026-03-30 05:20:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a26724a-46c7-5622-a89f-1089014ba93b with identifier: AM07460
2026-03-30 05:20:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a26724a-46c7-5622-a89f-1089014ba93b with identifier: AM07460
2026-03-30 05:20:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a26724a-46c7-5622-a89f-1089014ba93b with identifier: AM07460 to the API
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:50:47Z',
 'fuel_type': 'hybrid',
 'id': '5a26724a-46c7-5622-a89f-1089014ba93b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM07460',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 88621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-30 05:20:47 [auto1.nl] INFO: Saving data for AM07460: {'auction_closing_time': 1774885847.0, 'created_time': 1774638741.236711, 'last_price_update_time': 1774848047.223517}
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AM07460') HTTP/1.1" 204 0
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-30 05:20:47 [auto1.nl] INFO: Scrape type for CP77095: 0
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-30 05:20:47 [auto1.nl] INFO: Scrape type for FC64695: 0
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE91435%27 HTTP/1.1" 200 None
2026-03-30 05:20:47 [auto1.nl] INFO: Scrape type for FE91435: 0
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-30 05:20:47 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-30 05:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:20:52 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 758 | hits on page: 40
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Scrape type for TC15988: 0
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Scrape type for WJ55319: 0
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Scrape type for HK90585: 0
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB20368%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Scrape type for FB20368: 0
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Scrape type for CT01963: 2
2026-03-30 05:20:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with identifier: CT01963
2026-03-30 05:20:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with scrape type 2
2026-03-30 05:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with scrape type 2
2026-03-30 05:20:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8, identifier: CT01963
2026-03-30 05:20:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with identifier: CT01963
2026-03-30 05:20:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with identifier: CT01963
2026-03-30 05:20:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3818301d-8d5a-5264-97ab-7dbbb1fa02c8 with identifier: CT01963 to the API
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:23:04Z',
 'fuel_type': 'petrol',
 'id': '3818301d-8d5a-5264-97ab-7dbbb1fa02c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT01963',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 35324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-13',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2021}
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Saving data for CT01963: {'auction_closing_time': 1774884184.0, 'created_time': 1774552261.027983, 'last_price_update_time': 1774848052.626338}
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT01963') HTTP/1.1" 204 0
2026-03-30 05:20:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Scrape type for EB00697: 0
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Scrape type for VB13156: 0
2026-03-30 05:20:52 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-30 05:20:52 [auto1.nl] INFO: Scrape type for YR49127: 2
2026-03-30 05:20:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c27b70ed-0a59-5f7b-bc13-c42d28190b64 with identifier: YR49127
2026-03-30 05:20:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c27b70ed-0a59-5f7b-bc13-c42d28190b64 with scrape type 2
2026-03-30 05:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c27b70ed-0a59-5f7b-bc13-c42d28190b64 with scrape type 2
2026-03-30 05:20:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c27b70ed-0a59-5f7b-bc13-c42d28190b64, identifier: YR49127
2026-03-30 05:20:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c27b70ed-0a59-5f7b-bc13-c42d28190b64 with identifier: YR49127
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:20:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 05:20:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:20:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c27b70ed-0a59-5f7b-bc13-c42d28190b64 with identifier: YR49127
2026-03-30 05:20:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c27b70ed-0a59-5f7b-bc13-c42d28190b64 with identifier: YR49127 to the API
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 332,
 'expiration_date': '2026-03-30T15:24:11Z',
 'fuel_type': 'electro',
 'id': 'c27b70ed-0a59-5f7b-bc13-c42d28190b64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR49127',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model S',
 'odometer': 160983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-19',
 'seller_name': None,
 'title': 'Tesla Model S 70D Dual',
 'transmission': 'automatic',
 'trim': 'Dual',
 'year': 2017}
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-30 05:20:53 [auto1.nl] INFO: Saving data for YR49127: {'auction_closing_time': 1774884251.0, 'created_time': 1774638765.98776, 'last_price_update_time': 1774848053.264874}
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YR49127') HTTP/1.1" 204 0
2026-03-30 05:20:53 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-30 05:20:53 [auto1.nl] INFO: Scrape type for PN82428: 2
2026-03-30 05:20:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14cf79ee-0f10-554b-95d2-43660ad6962e with identifier: PN82428
2026-03-30 05:20:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14cf79ee-0f10-554b-95d2-43660ad6962e with scrape type 2
2026-03-30 05:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14cf79ee-0f10-554b-95d2-43660ad6962e with scrape type 2
2026-03-30 05:20:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14cf79ee-0f10-554b-95d2-43660ad6962e, identifier: PN82428
2026-03-30 05:20:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14cf79ee-0f10-554b-95d2-43660ad6962e with identifier: PN82428
2026-03-30 05:20:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14cf79ee-0f10-554b-95d2-43660ad6962e with identifier: PN82428
2026-03-30 05:20:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14cf79ee-0f10-554b-95d2-43660ad6962e with identifier: PN82428 to the API
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:02:44Z',
 'fuel_type': 'petrol',
 'id': '14cf79ee-0f10-554b-95d2-43660ad6962e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN82428',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 108444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-28',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport Plus',
 'transmission': 'manual',
 'trim': 'Sport Plus',
 'year': 2008}
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-30 05:20:53 [auto1.nl] INFO: Saving data for PN82428: {'auction_closing_time': 1774882964.0, 'created_time': 1774638764.951813, 'last_price_update_time': 1774848053.651148}
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PN82428') HTTP/1.1" 204 0
2026-03-30 05:20:53 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-30 05:20:53 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-30 05:20:53 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-30 05:20:53 [auto1.nl] INFO: Scrape type for RT17278: 2
2026-03-30 05:20:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with identifier: RT17278
2026-03-30 05:20:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with scrape type 2
2026-03-30 05:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with scrape type 2
2026-03-30 05:20:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee, identifier: RT17278
2026-03-30 05:20:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with identifier: RT17278
2026-03-30 05:20:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with identifier: RT17278
2026-03-30 05:20:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5bdd6d3b-b1d5-563a-851e-29c1f4c43bee with identifier: RT17278 to the API
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'diesel',
 'id': '5bdd6d3b-b1d5-563a-851e-29c1f4c43bee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT17278',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 97000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE Luxury',
 'transmission': 'automatic',
 'trim': 'HSE Luxury',
 'year': 2015}
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-30 05:20:54 [auto1.nl] INFO: Saving data for RT17278: {'auction_closing_time': 1774882938.0, 'created_time': 1774552309.48014, 'last_price_update_time': 1774848054.040691}
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT17278') HTTP/1.1" 204 0
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-30 05:20:54 [auto1.nl] INFO: Scrape type for WC97739: 0
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-30 05:20:54 [auto1.nl] INFO: Scrape type for BP06390: 0
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-30 05:20:54 [auto1.nl] INFO: Scrape type for VB96147: 0
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-30 05:20:54 [auto1.nl] INFO: Scrape type for DW43709: 0
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-30 05:20:54 [auto1.nl] INFO: Scrape type for SM08260: 2
2026-03-30 05:20:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca03c431-34cd-5d01-b909-594d9ae88a9d with identifier: SM08260
2026-03-30 05:20:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca03c431-34cd-5d01-b909-594d9ae88a9d with scrape type 2
2026-03-30 05:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca03c431-34cd-5d01-b909-594d9ae88a9d with scrape type 2
2026-03-30 05:20:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca03c431-34cd-5d01-b909-594d9ae88a9d, identifier: SM08260
2026-03-30 05:20:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca03c431-34cd-5d01-b909-594d9ae88a9d with identifier: SM08260
2026-03-30 05:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca03c431-34cd-5d01-b909-594d9ae88a9d with identifier: SM08260
2026-03-30 05:20:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca03c431-34cd-5d01-b909-594d9ae88a9d with identifier: SM08260 to the API
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:04:05Z',
 'fuel_type': 'diesel',
 'id': 'ca03c431-34cd-5d01-b909-594d9ae88a9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM08260',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 225698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2014}
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-30 05:20:54 [auto1.nl] INFO: Saving data for SM08260: {'auction_closing_time': 1774883045.0, 'created_time': 1774354363.028852, 'last_price_update_time': 1774848054.513337}
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SM08260') HTTP/1.1" 204 0
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-30 05:20:54 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-30 05:20:54 [auto1.nl] INFO: Scrape type for ZR54060: 2
2026-03-30 05:20:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a584e887-18b9-5c45-931c-298ae77cc50a with identifier: ZR54060
2026-03-30 05:20:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a584e887-18b9-5c45-931c-298ae77cc50a with scrape type 2
2026-03-30 05:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a584e887-18b9-5c45-931c-298ae77cc50a with scrape type 2
2026-03-30 05:20:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a584e887-18b9-5c45-931c-298ae77cc50a, identifier: ZR54060
2026-03-30 05:20:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a584e887-18b9-5c45-931c-298ae77cc50a with identifier: ZR54060
2026-03-30 05:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a584e887-18b9-5c45-931c-298ae77cc50a with identifier: ZR54060
2026-03-30 05:20:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a584e887-18b9-5c45-931c-298ae77cc50a with identifier: ZR54060 to the API
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:42:08Z',
 'fuel_type': 'petrol',
 'id': 'a584e887-18b9-5c45-931c-298ae77cc50a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR54060',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 296696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-09',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2011}
2026-03-30 05:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-30 05:20:55 [auto1.nl] INFO: Saving data for ZR54060: {'auction_closing_time': 1774885328.0, 'created_time': 1774552325.628811, 'last_price_update_time': 1774848055.009364}
2026-03-30 05:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR54060') HTTP/1.1" 204 0
2026-03-30 05:20:55 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-30 05:20:55 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-30 05:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:20:56 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 758 | hits on page: 40
2026-03-30 05:20:56 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-30 05:20:56 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-30 05:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-30 05:20:56 [auto1.nl] INFO: Scrape type for AB34968: 0
2026-03-30 05:20:56 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-30 05:20:56 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-30 05:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-30 05:20:56 [auto1.nl] INFO: Scrape type for WE00434: 2
2026-03-30 05:20:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a55519ca-1349-5fe6-8c0c-0f9c15a573bd with identifier: WE00434
2026-03-30 05:20:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a55519ca-1349-5fe6-8c0c-0f9c15a573bd with scrape type 2
2026-03-30 05:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a55519ca-1349-5fe6-8c0c-0f9c15a573bd with scrape type 2
2026-03-30 05:20:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a55519ca-1349-5fe6-8c0c-0f9c15a573bd, identifier: WE00434
2026-03-30 05:20:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a55519ca-1349-5fe6-8c0c-0f9c15a573bd with identifier: WE00434
2026-03-30 05:20:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a55519ca-1349-5fe6-8c0c-0f9c15a573bd with identifier: WE00434
2026-03-30 05:20:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a55519ca-1349-5fe6-8c0c-0f9c15a573bd with identifier: WE00434 to the API
2026-03-30 05:20:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:28:43Z',
 'fuel_type': 'petrol',
 'id': 'a55519ca-1349-5fe6-8c0c-0f9c15a573bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE00434',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 100942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-30 05:20:57 [auto1.nl] INFO: Saving data for WE00434: {'auction_closing_time': 1774884523.0, 'created_time': 1773924412.726741, 'last_price_update_time': 1774848057.064638}
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WE00434') HTTP/1.1" 204 0
2026-03-30 05:20:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:20:57 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-30 05:20:57 [auto1.nl] INFO: Scrape type for SZ87293: 2
2026-03-30 05:20:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with identifier: SZ87293
2026-03-30 05:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with scrape type 2
2026-03-30 05:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with scrape type 2
2026-03-30 05:20:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e, identifier: SZ87293
2026-03-30 05:20:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with identifier: SZ87293
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 05:20:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with identifier: SZ87293
2026-03-30 05:20:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f88dc51c-6ee0-5b82-8de8-223c90bcdf7e with identifier: SZ87293 to the API
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:10:27Z',
 'fuel_type': 'petrol',
 'id': 'f88dc51c-6ee0-5b82-8de8-223c90bcdf7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ87293',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 136694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Race',
 'transmission': 'manual',
 'trim': 'Color Race',
 'year': 2010}
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-30 05:20:57 [auto1.nl] INFO: Saving data for SZ87293: {'auction_closing_time': 1774883427.0, 'created_time': 1774638747.288693, 'last_price_update_time': 1774848057.557216}
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SZ87293') HTTP/1.1" 204 0
2026-03-30 05:20:57 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-30 05:20:57 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-30 05:20:57 [auto1.nl] INFO: Scrape type for SY05694: 0
2026-03-30 05:20:57 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-30 05:20:57 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-30 05:20:57 [auto1.nl] INFO: Scrape type for GL61326: 0
2026-03-30 05:20:57 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-30 05:20:57 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-30 05:20:57 [auto1.nl] INFO: Scrape type for YB51800: 0
2026-03-30 05:20:57 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-30 05:20:57 [auto1.nl] INFO: Scrape type for TP84646: 2
2026-03-30 05:20:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12414357-0885-5894-a8f5-27ee410c4b2e with identifier: TP84646
2026-03-30 05:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12414357-0885-5894-a8f5-27ee410c4b2e with scrape type 2
2026-03-30 05:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12414357-0885-5894-a8f5-27ee410c4b2e with scrape type 2
2026-03-30 05:20:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 12414357-0885-5894-a8f5-27ee410c4b2e, identifier: TP84646
2026-03-30 05:20:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 12414357-0885-5894-a8f5-27ee410c4b2e with identifier: TP84646
2026-03-30 05:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 12414357-0885-5894-a8f5-27ee410c4b2e with identifier: TP84646
2026-03-30 05:20:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 12414357-0885-5894-a8f5-27ee410c4b2e with identifier: TP84646 to the API
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:37:11Z',
 'fuel_type': 'hybrid',
 'id': '12414357-0885-5894-a8f5-27ee410c4b2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP84646',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 160762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 05:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Saving data for TP84646: {'auction_closing_time': 1774885031.0, 'created_time': 1774552319.731164, 'last_price_update_time': 1774848058.00475}
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP84646') HTTP/1.1" 204 0
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Scrape type for UF96545: 0
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Scrape type for EY58020: 2
2026-03-30 05:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with identifier: EY58020
2026-03-30 05:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with scrape type 2
2026-03-30 05:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with scrape type 2
2026-03-30 05:20:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868, identifier: EY58020
2026-03-30 05:20:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with identifier: EY58020
2026-03-30 05:20:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with identifier: EY58020
2026-03-30 05:20:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868 with identifier: EY58020 to the API
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:39:54Z',
 'fuel_type': 'petrol',
 'id': 'f5eea0a9-b2ea-51c9-ae9e-8a7e75e85868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY58020',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 172980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-01',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2013}
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Saving data for EY58020: {'auction_closing_time': 1774885194.0, 'created_time': 1774638730.43452, 'last_price_update_time': 1774848058.534018}
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY58020') HTTP/1.1" 204 0
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Scrape type for SG32295: 0
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Scrape type for TJ11018: 2
2026-03-30 05:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with identifier: TJ11018
2026-03-30 05:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with scrape type 2
2026-03-30 05:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with scrape type 2
2026-03-30 05:20:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69, identifier: TJ11018
2026-03-30 05:20:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with identifier: TJ11018
2026-03-30 05:20:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with identifier: TJ11018
2026-03-30 05:20:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69 with identifier: TJ11018 to the API
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:55Z',
 'fuel_type': 'petrol',
 'id': 'ce587a8c-e1c9-5faa-9b02-bd1b41dd4b69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ11018',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 83742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-12',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Saving data for TJ11018: {'auction_closing_time': 1774883395.0, 'created_time': 1774552355.526795, 'last_price_update_time': 1774848058.944952}
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TJ11018') HTTP/1.1" 204 0
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Scrape type for WY03082: 0
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-30 05:20:58 [auto1.nl] INFO: Scrape type for EU67961: 0
2026-03-30 05:20:58 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for FA26024: 2
2026-03-30 05:20:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d6a555-0950-5050-a757-4e98e1227bad with identifier: FA26024
2026-03-30 05:20:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d6a555-0950-5050-a757-4e98e1227bad with scrape type 2
2026-03-30 05:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46d6a555-0950-5050-a757-4e98e1227bad with scrape type 2
2026-03-30 05:20:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46d6a555-0950-5050-a757-4e98e1227bad, identifier: FA26024
2026-03-30 05:20:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46d6a555-0950-5050-a757-4e98e1227bad with identifier: FA26024
2026-03-30 05:20:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46d6a555-0950-5050-a757-4e98e1227bad with identifier: FA26024
2026-03-30 05:20:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46d6a555-0950-5050-a757-4e98e1227bad with identifier: FA26024 to the API
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:49:15Z',
 'fuel_type': 'petrol',
 'id': '46d6a555-0950-5050-a757-4e98e1227bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA26024',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 102390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-30',
 'seller_name': None,
 'title': 'Citroen C3 1.1 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2005}
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Saving data for FA26024: {'auction_closing_time': 1774885755.0, 'created_time': 1774552227.725255, 'last_price_update_time': 1774848059.352646}
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FA26024') HTTP/1.1" 204 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for TU99712: 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for BX66014: 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for BC50110: 2
2026-03-30 05:20:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b9489c-3e78-54b4-9fe1-9971457f18d8 with identifier: BC50110
2026-03-30 05:20:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b9489c-3e78-54b4-9fe1-9971457f18d8 with scrape type 2
2026-03-30 05:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82b9489c-3e78-54b4-9fe1-9971457f18d8 with scrape type 2
2026-03-30 05:20:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 82b9489c-3e78-54b4-9fe1-9971457f18d8, identifier: BC50110
2026-03-30 05:20:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 82b9489c-3e78-54b4-9fe1-9971457f18d8 with identifier: BC50110
2026-03-30 05:20:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 82b9489c-3e78-54b4-9fe1-9971457f18d8 with identifier: BC50110
2026-03-30 05:20:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 82b9489c-3e78-54b4-9fe1-9971457f18d8 with identifier: BC50110 to the API
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:33:17Z',
 'fuel_type': 'petrol',
 'id': '82b9489c-3e78-54b4-9fe1-9971457f18d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC50110',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 199083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-11',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Saving data for BC50110: {'auction_closing_time': 1774884797.0, 'created_time': 1774552347.355896, 'last_price_update_time': 1774848059.808802}
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC50110') HTTP/1.1" 204 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC54517%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for VC54517: 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY11680%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for BY11680: 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC21131%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for VC21131: 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR81542%27 HTTP/1.1" 200 None
2026-03-30 05:20:59 [auto1.nl] INFO: Scrape type for UR81542: 0
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-30 05:20:59 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-30 05:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR03129%27 HTTP/1.1" 200 None
2026-03-30 05:21:00 [auto1.nl] INFO: Scrape type for BR03129: 0
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP28763%27 HTTP/1.1" 200 None
2026-03-30 05:21:00 [auto1.nl] INFO: Scrape type for XP28763: 0
2026-03-30 05:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:21:00 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 758 | hits on page: 40
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL62659%27 HTTP/1.1" 200 None
2026-03-30 05:21:00 [auto1.nl] INFO: Scrape type for HL62659: 0
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF69205%27 HTTP/1.1" 200 None
2026-03-30 05:21:00 [auto1.nl] INFO: Scrape type for MF69205: 0
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH69810%27 HTTP/1.1" 200 None
2026-03-30 05:21:00 [auto1.nl] INFO: Scrape type for DH69810: 2
2026-03-30 05:21:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with identifier: DH69810
2026-03-30 05:21:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with scrape type 2
2026-03-30 05:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with scrape type 2
2026-03-30 05:21:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd, identifier: DH69810
2026-03-30 05:21:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with identifier: DH69810
2026-03-30 05:21:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with identifier: DH69810
2026-03-30 05:21:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e36e2a2d-cb1a-5074-8b9b-2c76a91593cd with identifier: DH69810 to the API
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:07:56Z',
 'fuel_type': 'petrol',
 'id': 'e36e2a2d-cb1a-5074-8b9b-2c76a91593cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH69810',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 117453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-29',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH69810%27 HTTP/1.1" 200 None
2026-03-30 05:21:00 [auto1.nl] INFO: Saving data for DH69810: {'auction_closing_time': 1774883276.0, 'created_time': 1774725087.768553, 'last_price_update_time': 1774848060.761112}
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DH69810') HTTP/1.1" 204 0
2026-03-30 05:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-30 05:21:00 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB68589%27 HTTP/1.1" 200 None
2026-03-30 05:21:00 [auto1.nl] INFO: Scrape type for DB68589: 2
2026-03-30 05:21:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with identifier: DB68589
2026-03-30 05:21:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with scrape type 2
2026-03-30 05:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with scrape type 2
2026-03-30 05:21:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32, identifier: DB68589
2026-03-30 05:21:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with identifier: DB68589
2026-03-30 05:21:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with identifier: DB68589
2026-03-30 05:21:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36bdc8ce-b6db-55a0-867f-6f5eefb6ae32 with identifier: DB68589 to the API
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:45:59Z',
 'fuel_type': 'diesel',
 'id': '36bdc8ce-b6db-55a0-867f-6f5eefb6ae32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB68589',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 258098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-19',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB68589%27 HTTP/1.1" 200 None
2026-03-30 05:21:01 [auto1.nl] INFO: Saving data for DB68589: {'auction_closing_time': 1774885559.0, 'created_time': 1774725091.455606, 'last_price_update_time': 1774848061.248431}
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DB68589') HTTP/1.1" 204 0
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG42782%27 HTTP/1.1" 200 None
2026-03-30 05:21:01 [auto1.nl] INFO: Scrape type for WG42782: 0
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF41961%27 HTTP/1.1" 200 None
2026-03-30 05:21:01 [auto1.nl] INFO: Scrape type for RF41961: 0
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC40672%27 HTTP/1.1" 200 None
2026-03-30 05:21:01 [auto1.nl] INFO: Scrape type for BC40672: 0
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR08670%27 HTTP/1.1" 200 None
2026-03-30 05:21:01 [auto1.nl] INFO: Scrape type for PR08670: 2
2026-03-30 05:21:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfacca18-57fe-552a-b2ec-4360fc335b25 with identifier: PR08670
2026-03-30 05:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfacca18-57fe-552a-b2ec-4360fc335b25 with scrape type 2
2026-03-30 05:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfacca18-57fe-552a-b2ec-4360fc335b25 with scrape type 2
2026-03-30 05:21:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bfacca18-57fe-552a-b2ec-4360fc335b25, identifier: PR08670
2026-03-30 05:21:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bfacca18-57fe-552a-b2ec-4360fc335b25 with identifier: PR08670
2026-03-30 05:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bfacca18-57fe-552a-b2ec-4360fc335b25 with identifier: PR08670
2026-03-30 05:21:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bfacca18-57fe-552a-b2ec-4360fc335b25 with identifier: PR08670 to the API
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:48:28Z',
 'fuel_type': 'diesel',
 'id': 'bfacca18-57fe-552a-b2ec-4360fc335b25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR08670',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 222544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-18',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Advantage',
 'transmission': 'automatic',
 'trim': 'EfficientDynamics Advantage',
 'year': 2016}
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR08670%27 HTTP/1.1" 200 None
2026-03-30 05:21:01 [auto1.nl] INFO: Saving data for PR08670: {'auction_closing_time': 1774885708.0, 'created_time': 1774725088.982398, 'last_price_update_time': 1774848061.70481}
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PR08670') HTTP/1.1" 204 0
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-30 05:21:01 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR36555%27 HTTP/1.1" 200 None
2026-03-30 05:21:01 [auto1.nl] INFO: Scrape type for DR36555: 2
2026-03-30 05:21:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with identifier: DR36555
2026-03-30 05:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with scrape type 2
2026-03-30 05:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with scrape type 2
2026-03-30 05:21:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 10d8dbde-ff44-5459-855c-f7e8e8c1f684, identifier: DR36555
2026-03-30 05:21:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with identifier: DR36555
2026-03-30 05:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with identifier: DR36555
2026-03-30 05:21:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 10d8dbde-ff44-5459-855c-f7e8e8c1f684 with identifier: DR36555 to the API
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:21Z',
 'fuel_type': 'petrol',
 'id': '10d8dbde-ff44-5459-855c-f7e8e8c1f684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR36555',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 113201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Beats BlueMotion',
 'transmission': 'manual',
 'trim': 'Beats BlueMotion',
 'year': 2017}
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR36555%27 HTTP/1.1" 200 None
2026-03-30 05:21:02 [auto1.nl] INFO: Saving data for DR36555: {'auction_closing_time': 1774883301.0, 'created_time': 1774725103.118411, 'last_price_update_time': 1774848062.085718}
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR36555') HTTP/1.1" 204 0
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ98625%27 HTTP/1.1" 200 None
2026-03-30 05:21:02 [auto1.nl] INFO: Scrape type for BZ98625: 0
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM68754%27 HTTP/1.1" 200 None
2026-03-30 05:21:02 [auto1.nl] INFO: Scrape type for GM68754: 0
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP71821%27 HTTP/1.1" 200 None
2026-03-30 05:21:02 [auto1.nl] INFO: Scrape type for JP71821: 2
2026-03-30 05:21:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b300dc7b-9d15-52fe-b3e6-d5c827187e55 with identifier: JP71821
2026-03-30 05:21:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b300dc7b-9d15-52fe-b3e6-d5c827187e55 with scrape type 2
2026-03-30 05:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b300dc7b-9d15-52fe-b3e6-d5c827187e55 with scrape type 2
2026-03-30 05:21:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b300dc7b-9d15-52fe-b3e6-d5c827187e55, identifier: JP71821
2026-03-30 05:21:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b300dc7b-9d15-52fe-b3e6-d5c827187e55 with identifier: JP71821
2026-03-30 05:21:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b300dc7b-9d15-52fe-b3e6-d5c827187e55 with identifier: JP71821
2026-03-30 05:21:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b300dc7b-9d15-52fe-b3e6-d5c827187e55 with identifier: JP71821 to the API
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:34:31Z',
 'fuel_type': 'hybrid',
 'id': 'b300dc7b-9d15-52fe-b3e6-d5c827187e55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP71821',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 58984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-03',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP71821%27 HTTP/1.1" 200 None
2026-03-30 05:21:02 [auto1.nl] INFO: Saving data for JP71821: {'auction_closing_time': 1774884871.0, 'created_time': 1774725086.954978, 'last_price_update_time': 1774848062.5951}
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JP71821') HTTP/1.1" 204 0
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG04233%27 HTTP/1.1" 200 None
2026-03-30 05:21:02 [auto1.nl] INFO: Scrape type for BG04233: 0
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-30 05:21:02 [auto1.nl] INFO: Scrape type for AT06250: 0
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-30 05:21:02 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW17706%27 HTTP/1.1" 200 None
2026-03-30 05:21:02 [auto1.nl] INFO: Scrape type for JW17706: 2
2026-03-30 05:21:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with identifier: JW17706
2026-03-30 05:21:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with scrape type 2
2026-03-30 05:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with scrape type 2
2026-03-30 05:21:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8, identifier: JW17706
2026-03-30 05:21:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with identifier: JW17706
2026-03-30 05:21:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with identifier: JW17706
2026-03-30 05:21:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8 with identifier: JW17706 to the API
2026-03-30 05:21:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'petrol',
 'id': '6b169c4a-8f4b-5896-a1d7-c8d24ffe66b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW17706',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 179660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-12',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style',
 'transmission': 'manual',
 'trim': 'Sport & Style',
 'year': 2009}
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW17706%27 HTTP/1.1" 200 None
2026-03-30 05:21:04 [auto1.nl] INFO: Saving data for JW17706: {'auction_closing_time': 1774886222.0, 'created_time': 1774725088.554603, 'last_price_update_time': 1774848064.074203}
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW17706') HTTP/1.1" 204 0
2026-03-30 05:21:04 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU81834%27 HTTP/1.1" 200 None
2026-03-30 05:21:04 [auto1.nl] INFO: Scrape type for GU81834: 2
2026-03-30 05:21:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with identifier: GU81834
2026-03-30 05:21:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with scrape type 2
2026-03-30 05:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with scrape type 2
2026-03-30 05:21:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6, identifier: GU81834
2026-03-30 05:21:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with identifier: GU81834
2026-03-30 05:21:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with identifier: GU81834
2026-03-30 05:21:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: af8b3a3e-7397-5cdf-9e29-57f390a8ccb6 with identifier: GU81834 to the API
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-30T15:12:00Z',
 'fuel_type': 'petrol',
 'id': 'af8b3a3e-7397-5cdf-9e29-57f390a8ccb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU81834',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 150140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-31',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2007}
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU81834%27 HTTP/1.1" 200 None
2026-03-30 05:21:04 [auto1.nl] INFO: Saving data for GU81834: {'auction_closing_time': 1774883520.0, 'created_time': 1774725102.289778, 'last_price_update_time': 1774848064.55332}
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GU81834') HTTP/1.1" 204 0
2026-03-30 05:21:04 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC15859%27 HTTP/1.1" 200 None
2026-03-30 05:21:04 [auto1.nl] INFO: Scrape type for BC15859: 2
2026-03-30 05:21:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893f96e0-d223-5919-a1fc-d8e1a1ca279f with identifier: BC15859
2026-03-30 05:21:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f with scrape type 2
2026-03-30 05:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 893f96e0-d223-5919-a1fc-d8e1a1ca279f with scrape type 2
2026-03-30 05:21:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 893f96e0-d223-5919-a1fc-d8e1a1ca279f, identifier: BC15859
2026-03-30 05:21:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 893f96e0-d223-5919-a1fc-d8e1a1ca279f with identifier: BC15859
2026-03-30 05:21:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 893f96e0-d223-5919-a1fc-d8e1a1ca279f with identifier: BC15859
2026-03-30 05:21:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 893f96e0-d223-5919-a1fc-d8e1a1ca279f with identifier: BC15859 to the API
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:28Z',
 'fuel_type': 'petrol',
 'id': '893f96e0-d223-5919-a1fc-d8e1a1ca279f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC15859',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 135168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-08',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2014}
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC15859%27 HTTP/1.1" 200 None
2026-03-30 05:21:04 [auto1.nl] INFO: Saving data for BC15859: {'auction_closing_time': 1774884268.0, 'created_time': 1774725099.879678, 'last_price_update_time': 1774848064.964311}
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC15859') HTTP/1.1" 204 0
2026-03-30 05:21:04 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-30 05:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR27425%27 HTTP/1.1" 200 None
2026-03-30 05:21:05 [auto1.nl] INFO: Scrape type for XR27425: 2
2026-03-30 05:21:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3bbac99-6b47-5e01-a757-fc39521f32e1 with identifier: XR27425
2026-03-30 05:21:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3bbac99-6b47-5e01-a757-fc39521f32e1 with scrape type 2
2026-03-30 05:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3bbac99-6b47-5e01-a757-fc39521f32e1 with scrape type 2
2026-03-30 05:21:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c3bbac99-6b47-5e01-a757-fc39521f32e1, identifier: XR27425
2026-03-30 05:21:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c3bbac99-6b47-5e01-a757-fc39521f32e1 with identifier: XR27425
2026-03-30 05:21:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c3bbac99-6b47-5e01-a757-fc39521f32e1 with identifier: XR27425
2026-03-30 05:21:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c3bbac99-6b47-5e01-a757-fc39521f32e1 with identifier: XR27425 to the API
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:07:43Z',
 'fuel_type': 'petrol',
 'id': 'c3bbac99-6b47-5e01-a757-fc39521f32e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR27425',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 100707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-26',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2008}
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR27425%27 HTTP/1.1" 200 None
2026-03-30 05:21:05 [auto1.nl] INFO: Saving data for XR27425: {'auction_closing_time': 1774883263.0, 'created_time': 1774725100.46207, 'last_price_update_time': 1774848065.405857}
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XR27425') HTTP/1.1" 204 0
2026-03-30 05:21:05 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME79677%27 HTTP/1.1" 200 None
2026-03-30 05:21:05 [auto1.nl] INFO: Scrape type for ME79677: 2
2026-03-30 05:21:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c9239e5-1b78-5fab-b285-e59375f27b28 with identifier: ME79677
2026-03-30 05:21:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9239e5-1b78-5fab-b285-e59375f27b28 with scrape type 2
2026-03-30 05:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c9239e5-1b78-5fab-b285-e59375f27b28 with scrape type 2
2026-03-30 05:21:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7c9239e5-1b78-5fab-b285-e59375f27b28, identifier: ME79677
2026-03-30 05:21:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7c9239e5-1b78-5fab-b285-e59375f27b28 with identifier: ME79677
2026-03-30 05:21:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7c9239e5-1b78-5fab-b285-e59375f27b28 with identifier: ME79677
2026-03-30 05:21:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7c9239e5-1b78-5fab-b285-e59375f27b28 with identifier: ME79677 to the API
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:21:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:12:09Z',
 'fuel_type': 'diesel',
 'id': '7c9239e5-1b78-5fab-b285-e59375f27b28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME79677',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 101066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-26',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME79677%27 HTTP/1.1" 200 None
2026-03-30 05:21:05 [auto1.nl] INFO: Saving data for ME79677: {'auction_closing_time': 1774883529.0, 'created_time': 1774725093.170464, 'last_price_update_time': 1774848065.779464}
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME79677') HTTP/1.1" 204 0
2026-03-30 05:21:05 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-30 05:21:05 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-30 05:21:06 [scrapy.extensions.logstats] INFO: Crawled 19 pages (at 5 pages/min), scraped 109 items (at 36 items/min)
2026-03-30 05:21:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-30 05:22:06 [scrapy.extensions.logstats] INFO: Crawled 19 pages (at 0 pages/min), scraped 109 items (at 0 items/min)
2026-03-30 05:22:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-30 05:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:22:11 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 758 | hits on page: 40
2026-03-30 05:22:11 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-30 05:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT04530%27 HTTP/1.1" 200 None
2026-03-30 05:22:11 [auto1.nl] INFO: Scrape type for PT04530: 2
2026-03-30 05:22:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3190eb8d-0462-54fb-917c-2ba1550b9699 with identifier: PT04530
2026-03-30 05:22:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3190eb8d-0462-54fb-917c-2ba1550b9699 with scrape type 2
2026-03-30 05:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3190eb8d-0462-54fb-917c-2ba1550b9699 with scrape type 2
2026-03-30 05:22:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3190eb8d-0462-54fb-917c-2ba1550b9699, identifier: PT04530
2026-03-30 05:22:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3190eb8d-0462-54fb-917c-2ba1550b9699 with identifier: PT04530
2026-03-30 05:22:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3190eb8d-0462-54fb-917c-2ba1550b9699 with identifier: PT04530
2026-03-30 05:22:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3190eb8d-0462-54fb-917c-2ba1550b9699 with identifier: PT04530 to the API
2026-03-30 05:22:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:22:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:03Z',
 'fuel_type': 'diesel',
 'id': '3190eb8d-0462-54fb-917c-2ba1550b9699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT04530',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 139378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-21',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L2 Premium',
 'transmission': 'manual',
 'trim': 'L2 Premium',
 'year': 2018}
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT04530%27 HTTP/1.1" 200 None
2026-03-30 05:22:12 [auto1.nl] INFO: Saving data for PT04530: {'auction_closing_time': 1774883463.0, 'created_time': 1774725101.904705, 'last_price_update_time': 1774848132.125013}
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PT04530') HTTP/1.1" 204 0
2026-03-30 05:22:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:22:12 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-30 05:22:12 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-30 05:22:12 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS03610%27 HTTP/1.1" 200 None
2026-03-30 05:22:12 [auto1.nl] INFO: Scrape type for PS03610: 0
2026-03-30 05:22:12 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-30 05:22:12 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18286%27 HTTP/1.1" 200 None
2026-03-30 05:22:12 [auto1.nl] INFO: Scrape type for MD18286: 2
2026-03-30 05:22:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d2ca630-420e-5a93-8498-d64476322ff4 with identifier: MD18286
2026-03-30 05:22:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d2ca630-420e-5a93-8498-d64476322ff4 with scrape type 2
2026-03-30 05:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d2ca630-420e-5a93-8498-d64476322ff4 with scrape type 2
2026-03-30 05:22:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6d2ca630-420e-5a93-8498-d64476322ff4, identifier: MD18286
2026-03-30 05:22:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6d2ca630-420e-5a93-8498-d64476322ff4 with identifier: MD18286
2026-03-30 05:22:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6d2ca630-420e-5a93-8498-d64476322ff4 with identifier: MD18286
2026-03-30 05:22:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6d2ca630-420e-5a93-8498-d64476322ff4 with identifier: MD18286 to the API
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:22:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:22:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:26Z',
 'fuel_type': 'petrol',
 'id': '6d2ca630-420e-5a93-8498-d64476322ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD18286',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 112292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18286%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Saving data for MD18286: {'auction_closing_time': 1774886246.0, 'created_time': 1774725089.709973, 'last_price_update_time': 1774848133.132277}
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD18286') HTTP/1.1" 204 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB08844%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for EB08844: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV55742%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for PV55742: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM51490%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for AM51490: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD35327%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for MD35327: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR09691%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for TR09691: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX19183%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for KX19183: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for JH24547: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL97424%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for HL97424: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB85439%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for AB85439: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for UE65811: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for UY86442: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for WG90560: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-30 05:22:13 [auto1.nl] INFO: Scrape type for UR39080: 0
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-30 05:22:13 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-30 05:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:22:21 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 758 | hits on page: 40
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for PH88105: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for UF12505: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for XK28167: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for JC30911: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for AX92237: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for UB73502: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for TP02076: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for BV07887: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for ZE09391: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for ER86910: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for DR23359: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for MH16372: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for ME24209: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for PU27111: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for EH33258: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for SE67800: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for TN45594: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK48702%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for HK48702: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX89333%27 HTTP/1.1" 200 None
2026-03-30 05:22:21 [auto1.nl] INFO: Scrape type for PX89333: 0
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-30 05:22:21 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-30 05:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-30 05:22:22 [auto1.nl] INFO: Scrape type for JM32164: 0
2026-03-30 05:22:22 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-30 05:22:22 [auto1.nl] INFO: Scrape type for HM06318: 0
2026-03-30 05:22:22 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-30 05:22:22 [auto1.nl] INFO: Scrape type for KH60865: 0
2026-03-30 05:22:22 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS42620%27 HTTP/1.1" 200 None
2026-03-30 05:22:22 [auto1.nl] INFO: Scrape type for GS42620: 0
2026-03-30 05:22:22 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ91466%27 HTTP/1.1" 200 None
2026-03-30 05:22:22 [auto1.nl] INFO: Scrape type for YJ91466: 0
2026-03-30 05:22:22 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-30 05:22:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:22:56 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 758 | hits on page: 40
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for PA65227: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG71940%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for HG71940: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV57262%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for MV57262: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS29188%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for VS29188: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ45478%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for ZZ45478: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW57039%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for RW57039: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM15601%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for HM15601: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP36316%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for GP36316: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for UE83954: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for XG85677: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for SX97177: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for PF57895: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for HV92208: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for WY33906: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for WN49119: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for XM87869: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-30 05:22:56 [auto1.nl] INFO: Scrape type for FB82909: 0
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-30 05:22:56 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-30 05:22:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:22:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:22:57 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 758 | hits on page: 38
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for YX65431: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for MZ74119: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for GW58352: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for JB09830: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for CY78777: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for DL13637: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for CD19489: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for RY80321: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for KC04488: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for SK13348: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for JB39700: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for NZ86515: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for WK03460: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for FG02230: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for NX59327: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for AB36156: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-30 05:22:57 [auto1.nl] INFO: Scrape type for JW97628: 0
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-30 05:22:57 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-30 05:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-30 05:22:58 [auto1.nl] INFO: Scrape type for LR40141: 0
2026-03-30 05:22:58 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-30 05:22:58 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-30 05:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-30 05:22:58 [auto1.nl] INFO: Scrape type for EP93197: 0
2026-03-30 05:22:58 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-30 05:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-30 05:22:58 [auto1.nl] INFO: Scrape type for DT42929: 0
2026-03-30 05:22:58 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-30 05:22:58 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-30 05:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-30 05:22:58 [auto1.nl] INFO: Scrape type for AV73218: 0
2026-03-30 05:22:58 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-30 05:22:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:23:05 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 758 | hits on page: 0
2026-03-30 05:23:05 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 05:23:05 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-30 05:23:05 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 75, <ScrapeType.BATCH_SKIPPED: 5>: 77}
2026-03-30 05:23:06 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (111 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-30T05_10_00.jl
2026-03-30 05:23:06 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 64058,
 'downloader/request_count': 24,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 22,
 'downloader/response_bytes': 3430045,
 'downloader/response_count': 24,
 'downloader/response_status_count/200': 24,
 'elapsed_time_seconds': 779.782957,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 5, 23, 6, 414458, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 111,
 'log_count/DEBUG': 1674,
 'log_count/INFO': 2182,
 'memusage/max': 164765696,
 'memusage/startup': 149897216,
 'request_depth_max': 23,
 'response_received_count': 24,
 'scheduler/dequeued': 24,
 'scheduler/dequeued/memory': 24,
 'scheduler/enqueued': 24,
 'scheduler/enqueued/memory': 24,
 'scrape_type/batch_skipped': 402,
 'scrape_type/price_update': 111,
 'scrape_type/skipped': 285,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 27,
 'scrapy-zyte-api/error_ratio': 0.1111111111111111,
 'scrapy-zyte-api/errors': 3,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 3,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 14.631838137109298,
 'scrapy-zyte-api/mean_response_seconds': 14.756604877805026,
 'scrapy-zyte-api/processed': 24,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 24,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 23,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 24,
 'scrapy-zyte-api/request_args/httpRequestBody': 22,
 'scrapy-zyte-api/request_args/httpRequestMethod': 22,
 'scrapy-zyte-api/request_args/httpResponseBody': 24,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 24,
 'scrapy-zyte-api/request_args/sessionContext': 24,
 'scrapy-zyte-api/request_args/url': 24,
 'scrapy-zyte-api/status_codes/0': 3,
 'scrapy-zyte-api/status_codes/200': 24,
 'scrapy-zyte-api/success': 24,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 798,
 'source/total_available': 758,
 'start_time': datetime.datetime(2026, 3, 30, 5, 10, 6, 631501, tzinfo=datetime.timezone.utc)}
2026-03-30 05:23:06 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 05:23:06 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f60c7805b10>
2026-03-30 05:23:06 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f60c753e650>